DISTRIBUTION OF VALUES OF QUADRATIC FORMS AT 

INTEGRAL POINTS * 



FRIEDRICH GOTZE AND GREGORY MARGULIS 

Abstract. The number of lattice points in d-dimensional hyperbolic or elliptic shells 
{m; a < Q[m\ < b} which are restricted to rescaled and growing domains rfi is ap- 
proximated by the volume. An effective error bound of order o{r'^~^) for this approx- 
imation is proved based on Diophantine approximation properties of the quadratic 
form Q. These results allow to show effective variants of previous non-effective re- 
sults in the quantitative Oppenheim problem and extend known effective results in 
dimension d > 9 to dimension d > 5. They apply to wide shells when 6 — a is growing 
with r and to positive forms Q. For indefinite forms they provide explicit bounds for 
the norm of non-zero integral points m in dimension d > 5 solving the Diophantine 
inequality < £■ 



1. Introduction and Results 

Let Q[x] denote an indefinite quadratic form in d variables. We say, tliat tlie form Q 
is rational, if it is proportional to a form with integer coefficients; otherwise it is called 
irrational. The Oppenheim conjecture, proved by G. Margulis 1986, |Marg89 stated. 



that if c? > 3 and Q is irrational, then Q[Z'^] is dense in M. The proof given in 1986 
uses a connection, noticed by M. S. Raghunathan between the Oppenheim conjecture 
and questions concerning closures in S'L(3, ]R)/S'L(3, Z) of orbits of certain subgroups 
of S'L(3,M). It is based on the study of minimal invariant sets and the limits of orbits 
of sequences of points tending to a minimal invariant set. 

For a (measurable) set B C Mf^, vol B denotes the Lebesgue measure of B and vol^B =^ 
i^{B n Z'^) denotes the number of integer points on B. We define for a, 6 G M, with 
a < b the hyperbolic shell 

E^^^ = {x G M'^;a < Q[x] < b}. 

The Oppenheim conjecture is equivalent to the statement, that if Q is irrational and 
d>3, then vo\iEa^b = oo, whenever a < b. The study of the distribution of values of 
Q at integer points, often referred to as "quantitative Oppenheim conjecture" was the 
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subject of several papers. 

Let p be a continuous positive function on the sphere {t; G M'^ : H^'H = 1} and let 
Q = {v E : \\v\\ < piv/\\v\\)}. We denote by r^l the dilate of by r > 1. 
In |DM93] S.G. Dani and G. Margulis obtained the following asymptotic exact lower 
bound under the same assumptions that Q is irrational and d > 3 : 

limmf^'°'f'^""'„"'>l, (1.1) 

Remark 1.1. It is not difficult to prove (see Lemma 3.8 in [EMM98]) that as r — oo, 

Yo\ iEa,b n rn) \Q,nib- ay-', 

where 

L is the light cone Q = and dA is the area element on L. 

The situation with asymptotics and upper bounds is more subtle. It was proved 
in |EMM98] that if Q is an irrational indefinite quadratic form of signature {p,q), 
p + q = d, with p > 3 and q > 1, then for any a < b 

Mm ""'f'f-'^'-f'' = 1 (1,3) 

r->oo vol {Eafi H r^l) 

or, equivalently, as r — )■ oo, 

volz {Ea,b n rQ) ~ \Q,n{b - ay-', (1.4) 

where Xg^n is as in (11. 2p . 

If the signature of Q is (2, 1) or (2, 2) then no universal formula like (II. 4p holds. In 
fact, it is proved in |EMM98] that if Q is the unit ball and g = 1 or 2, then for every 
e > and every a < b there exist an irrational quadratic form Q of signature (2, q) and 
a constant c > such that for an infinite sequence rj — )■ oo 

volz iEa,b n rfi) > crj (log rj)^-^ 

While the asymptotics as in (11.41) does not hold in the case of signatures (2, 1) and 
(2,2), it is shown in |EMM98) that in this case there is an upper bound of the form 

logr. This upper bound is effective and it is uniform over compact sets in the space 
of quadratic forms. It is also shown in |EMM98] that there is an effective uniform 
upper bound of the form cr'^~^ for the case p > 3, q > 1. 

The examples in |EMM98] for the case of signatures (2, 1) and (2, 2) are obtained by 
considerations of irrational forms which are very well approximated by split rational 
forms. More precisely, a quadratic form Q is called extremely well approximable by 
split rational forms (EWAS) if for any > there exists a split integral form Q' and 
2<keR such that 

II^Q-Q'II<^, 
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where || ■ || denotes a norm on the hnear space of quadratic forms. It is shown in 
|EMM98] that if Q is an indefinite quadratic form of signature (2, 2) which is not 
EWAS then for any interval (a, &), as r — )■ oo, 

iVQ,n(a,fe,r) ~ AQ,f,(6-a)r^ (1.5) 

where Xq^n is the same as in (11. 2p and NQ^Q{a,b,r) counts all the integral points in 
Ea^b n rQ not contained in rational subspaces isotropic with respect to Q. It should be 
noted that 

(i) an irrational quadratic form of signature (2, 2) may have at most four rational 
isotropic subspaces 

(ii) if ^ (a, b), then Ng^nia, b, r) = volz {Ea,b n rfi). 

The above mentioned results have analogs for inhomogeneous quadratic forms 

Qd^]=Q[x + ^], ^eR". 

We define for a, 6 G M with a < b the shifted hyperbolic shell 

EaM = {x eR'^ : a < Q^[x] < b}. 

We say that is rational if there exists t > such that the coefficients of tQ and the 
coordinates of are integers; otherwise is irrational. Then, under the assumptions 
that is irrational and d > 3, we have that (see |MM10| ) 

liminf""^f/^"'^'^^^^,^ >1. (1.6) 

r-!>oo vol [Ea^b,^ H ru) 

The proof of (11. 6p is similar to the proof of (II. ip . 

Let {p, q) be the signature of Q. U p > 3, q > 1, and is irrational then (see 
[MMlOp 

hm ""t^f = 1 (1-7) 
vol {Ea,b,i nrQ) 

or, equivalently, as r — )■ oo, 

volz {EaM,i n rQ) ~ \Q^n{b - ay~\ (1.8) 

The proof of (ll.7p is similar to the proof of (II. 3p . The paper |MM10| also contains 
an analog of (II. 5p for inhomogeneous forms in the case of signature (2, 2). One should 
also mention related results of Marklof |Mark02[ IMark03 . 



Remark 1.2. The proofs of the above mentioned results use such notions as a minimal 
invariant set (in the case of the Oppenheim conjecture) and an ergodic invariant mea- 
sure. These notions do not have in general effective analogs. Because of that it is very 
difficult to get "good" estimates for the size of the smallest nontrivial integral solution 
of the inequality < e and "good" error terms in the quantitative Oppenheim 

conjecture by applying dynamical and ergodic methods. 
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1.1. Diophantine inequalities. In the next sections we shall develop effective analogs 
of the results above which are needed to show that for irrational Q , |(5[?ti]| < e admits 
a nontrivial integral solution m with size measured in terms of e~^. For rational Q 
recall the following results for integer valued quadratic forms from reduction theory 
and the geometry of numbers. Let A[m\ denote an integer valued indefinite quadratic 
form on a d-dimensional lattice A in W^. Meyer (1884), |Mey84| , showed that such 
a form has a non-trivial zero on A if (i > 5. Moreover, Birch and Davenport (1958), 
|BD58b) . showed that 



Theorem 1.3. If A[m] admits a nontrivial zero on A then there exist an m ^ \ with 
Euclidean norm 

< ||m|| < 7d(2Tr A2)('^-i)/2(detA)2, (1.9) 
where 7^ denotes Hermite's constant. 

We shall use these results together with effective errors bounds for lattice point 
approximations to describe solutions of the Diophantine inequality |(5[?ti]| < 1 on Z'^ 
for all indefinite forms. 

Let Q denote as well the symmetric matrix in GL((i, M) associated with the form 

Q[x] '= {x,Qx), where (-,■) is the standard Euclidean scalar product on M°'. Let 
denote the unique positive symmetric matrix such that = and let = 
{x, x) denote the associated positive form with eigenvalues being the absolute eigen- 
values of Q. Let g, resp. go denote the largest resp. smallest of these absolute eigen- 
values of Q and assume qo>l. 

Theorem 1.4. For all indefinite forms nondegenerate forms of dimension d > 5 there 
exists an constant Cd^rj, depending on d and t] > only, such that there is nontrivial 
integral solution of \Q[m]\ < 1 with 

< Q+[m] < Q,^|detg|g^+^ (1.10) 

for arbitrary small t] > 0. 

Note that for a compact set of forms Q, such that 1 < Qo < q < C{d), for some 
constant C{d) depending on d only, we obtain nontrivial integral solutions of < e 

(via rescaling |((5/£)[rra]| < 1) with norms bounded by ||m|| < Cd,r)£~'^~^^~'^~^ for 
?7 > abitrary small. Embedding 7? C Z*^ for dimensions d > 5 (i.e. choosing d — 5 
coordinates to be zero), solutions of |Q[mo]| < 1 for the case of 5 dimensions provide 
solutions of this Diophantine inequality for d > 5. Thus the case of ci = 5 is of particular 
importance. Here Theorem 1 1 . 4l yields a nontrivial integral solution of | < e of size 
< |m| < Cd^n e"^"^"^. For the special case of diagonal mdeHmte forms Q[x] = Yl^j=i ^j^] 
with min|gj| > 1 Birch and Davenport (1958), |BD58a| . obtained a sharper bound. 
They showed for arbitrary small 77 > that there exists an m G \ with < 1 

and Q+f'Ti] '^d,rj {detQ^Y~^^. This implies (as above) for that compact set of forms Q 
that there exists an integral vector m with ||m|| < Q,,, e"^'^'' and < < e. 
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For irrational indefinite quadratic forms we may quantify the density of values Q[m] 
m G rl] n Z'^ as follows. Let Cq > denote a positive constant. Consider the set 

V{r) "=^' { g[m] : me C/co n Z''} n [-Cq r^, cq r^] 

of values of Q[x] lying in the interval [— Cq r^, Cq r^], for x G Cr/co- We define the 
maximal gap between successive values as 

d{r) =^ sup inf — n : v>u,v&V{r)Y (l-H) 

ueV{r) 

As a consequence of our quantitative bounds in Theorems 12.11 12.51 below we obtain 

Corollary 1.5. Let Q denote a non- degenerate d- dimensional indefinite form, which 
satisfies a Diophantine condition of type (k,A) in ( ll.lSp below for k > sufficiently 
small. Then for a fixed sufficiently small constant Cq > 0, there exists a constant c,^^A,Q,d 
(explicitly depending on n, A, Q and d) such that the maximal gap is hounded from 
above by 

d{r) < Cd,.^A,Qr-'''\ (1.12) 

for sufficiently large r, where uq =^ (1 — k)(1 — {4 + 6)/d) and < 6 < 1/10 is defined 
in Theorem \2.1[ 

For positive definite quadratic forms, Davenport and Lewis |DL72) conjectured in 
1972, that the distance between successive values Vn of the quadratic form Q[x\ on l/- 
converges to zero as n — t- oo, provided that the dimension d is at least five and Q is 
irrational. This conjecture was proved in Gotze |Got04| . 

The conjecture follows by the techniques of the present paper as well which provides 
error bounds for the lattice point counting problem for the indefinite case as well as 
the positive definite case. 

The proof is similar as in the case of positive forms solved in |Got04| : For any £ > 



and any interval [6,6 + e], we find at least two lattice points in the shell -Efe^h+e (and 
the box of size r = 2\/6), by Corollary 12. 3[ provided that h is larger than a threshold 
h{e). Here h{e) and consequently the distance between successive values (as a function 
of h) depends on the rate of convergence of the Diophantine characteristic p(r), (in the 
bound of Corollary 12. 3p . towards zero. 

1.2. Discussion of Effective Bounds and Outline of Proofs. In order to prove an 
effective result like Theorem [L4] we need an explicit bound for the error, say 5{rVLr\Ea^b)i 
of approximating the number of integral points m G Ea^b in a bounded domain r f2 by 
the volume in (11.21) . Since the description of these error bounds is more involved for 
general domains f2, we simplify the problem and first replace the weights 1 of integral 
points m G rl] by suitable smoothly changing weights w{m), which tend to zero as 
m/r tends to infinity. 

Smooth weights in M.'^. Using the weights w{x) '= exp{— (5+[x]/r^} our techniques 
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yield effective bounds for the approximation of a weighted count of lattice points m 
with Q[m] G [a, b] by a corresponding integral with an error 

S{r,Ea^h) '= I 10(771)— / w{x)dx\. (1-13) 

The following bounds for 5(r, Ea^) are identical for the case of positive and indefinite 
(i-dimensional forms Q, provided that d > 5. Using Vinogradov's notation A <^b C, 
(meaning that A < cbC with a constant cb > depending on B), we have 

6{r,Ea,b) r''-\b-a)pQ,,^air)+r'/'^-^, (1.14) 

provided that b — a < r. (If r < 6 — a ^ the second term in the bound has to be 
replaced by r'^/^ logr). The function PQ^b~a{r) tends to zero for r tending to infinity if 
Q is irrational. Moreover, assume that Q is Diophantine in the sense that there exist 
constants (k, A), n G (0,1) and ^4 > 0, such that for every integer matrix M and 
integer g 7^ we have 



inf \\Mq-^ - tQW > Aq-^-\ (1.15) 



ie 1,2 



Then we conclude that pqir, b — a) '^Q^d,A ^ '^^{b — a)^ where i^i, 1/2 G (0, 1) depend 
on d, K and A (see Corollary 12. 7p . 

Constant weights in rVL. Consider now regions VL introduced in (11. II) above. 

Introduce a i/;-smoothed indicator function, say /^^(Q[a;]), for Ea^b and an e-smoothed 
indicator function, say /.^^(x) for rVt. These smoothing procedures interpolate weights 
from 1 to in the w- resp. the e-boundaries of [a, b] resp. rVt. Provided that we can 
control both errors by estimating the volumes of ^-boundaries, (compare Lemma 13. 3[ 
Corollary 13.21 f l3.19p ). we then have to estimate 

w{77i)Il,{Q[77i])Il^{77i) - [ w{x)i:^Mx])r,^{x)dx K " Wr, Say, (1.16) 

in order to bound the lattice point counting error 6{rQ fl -Ea.fe)- Rewrite the weights in 
Vr (which are 1 in the interior of rQ fl Ea^b) as product of the three bounded weights 



w(m), (introduced above), Wi(m) =^ ^abiQi''^]) W2(m) =^ exp{Q^[7n]/r^} Hf, 
Using inverse Fourier transforms we may express these weights as 

wi{77i) = exp{-itQ[77i]}iJ,[a,b],w{t)dt, W2{7n) = / exp{-i{v,77i)}jj,n^s{v)dv, 
J 

with respect to some finite (signed) measures p[a,b],w and /x^.e- 



m 
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Combining the factors exp{—itQ[m\}, exp{ — (f,m)} in ( I1.16P and w{m) into terms 
of the generahzed theta series 

dv{t) '= exp{— z(t;,m) — itQ[rri\ — Q_|_[m]/r^} 

one arrives at an expression for by the following integral (in t and v) over 9^{t): 

Vr= dvfinA'") / dtf^la,b]A'tWv{t)- (1.17) 

jRd J 

The approximating integral Wr to this sum Vr can be rewritten in exactly the same way 
by means of a theta integral, say Qvit), replacing the theta sum 6y{t). Thus, in order to 
estimate the error |\^, — the integral over t and v of \9y{t) — 0„(t)||/i[a,6],ui(^)/^r2,e(^)| 
has to be estimated. 

For < and <C r the functions x h- )■ exp{itQ[x]} are sufficiently smooth, 
so that the sum 6y(t) is well approximable by the first term of its Poisson series, that 
is the corresponding integral Qv{t), (see Lemma H73|) . The error of this approximation, 
after integration over v, yields the second error term in (I1.14p . which does not depend 
on the Diophantine properties of Q. The remaining error term we have to consider (for 
an appropriate choice of T ~ is 

/= / dt dv\e^{t)fi[a,b],w{t)f^n,e{v)\, (1.18) 

JT>\t\>r-^ JR^ 

which is estimated as follows for k G (0, 1) 

I<yn,e\\l sup |ft„(t)r / dtsup%{t)\^-^\fl[a,b]At)l (1-19) 

T>|t|>r-i JT>|t|>r-i v 

where ll/in.elli = J\f^n,e\dv depends on the shape of the region Q and grows with the 
reciprocal of the e-smoothing of the region. The second factor in the bound of I in 
(I1.19P encodes the Diophantine behavior of Q as described above. The third factor 
is crucial. For some sufficiently small k (depending on d) this average over t is of 
order r'^~^, provided that d > 4, see Lemma [7. II The resulting bound, (when choosing 
w ~ as order of the smoothing parameter for the region Ea^b), is an error bound 
of the form (compare Theorem 12. ip 

6irn n Ea,b) <^d,Q s{h - ay-^ + ||/in,.||ip(r, h - a^-^ + //^^H^, (1.20) 

r 

which has to be optimized in the smoothing size e restricted to e r~^(logr)^. The 
first term is due to the intersection of Ea^b with the boundary of rQ. In the case of 
positive definite forms Q this intersection is empty for sufficiently large r, say r = 2\/b, 
when Ea^b C r/2fl. Hence we may drop this term and fix e, say at 1/16. (Compare 
Theorem 12. 3p . 
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The Diophantine factor p(r, b — a). In order to describe the second term in (11.201) . 
we show that (uniformly in v (see Lemma [4. 4p 



%{t)\' <r'Yl exp{-|K'f } = hr, (1.21) 

veAt 



where G SL{2d,'R)/ SL{2d,Z) is a family of 2(i-dimensional lattices generated by 
orbits of one-parameter-subgroups of SL{2d,'R) indexed by t and r. 
The average of over t is derived in Lemmas I6.11|7.1I and 17.21 using an involved 
recursion in the size of r and building on a method developed in |EMM98] about upper 
estimates of averages of certain functions on the space of lattices along translates of 
orbits of compact subgroups. At this point the current approach is fundamentally 
different to the approach of previous effective bounds for 6{rQ fl Ea^b) by Bentkus and 
Gotze |BG99) . see also |BG97| . valid for d > 9 and positive as well as indefinite forms. 



The reduction to and p(r, b — a) follows the approach used in Gotze, |Got04) . where 



It^r has been estimated for d > 5 by methods from Geometry of Numbers, which 
essentially required positive definite forms. A variant of that method has been applied 
to split indefinite forms in a PhD thesis by Eisner |Els09| . 

In order to study the existence of solutions to the Diophantine inequalities in Theo- 
rem [Ljl with explicit dependence on the eigenvalues of Q, we have restricted ourselves 
to consider special regions Q which are transformed cubes. This choice is motivated 
by the fact that in this case the first factor ||/Un,e||i in the error bound flL19p has an 
almost minimal growth (loge"^)"^ in e~^, see Lemma [4.11 

The paper is organized as follows. In the following Section 2 we describe the explicit 
technical estimates of lattice point remainders. In Section 3 we transfer the problem 
to Fourier space starting with a smoothing step and rewriting it in terms of integrals 
over (i-dimensional theta sums. Section 4 provides a reformulation of the problem via 
upper bounds in terms of integrals over the absolute value of other theta sums with 
symplectic structure on R^*^. These in turn are estimated using basic arguments from 
Geometry of Numbers, (Section 5) and in Section 6 based on crucial estimates for 
averages of functions on the space of lattices. Finally, in Section 7 all these results are 
combined to conclude the results of Section 2. 

Acknowledgments 
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2. Effective Estimates 
We consider the quadratic form 



Q[x] = {Qx,x), for xgM^ 
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where (-, ■) denotes the standard Euchdean scalar product and Q : — M'^ denotes a 
symmetric hnear operator in GL{d, M) with eigenvalues, say, gi, . . . , g^. Write 

def . I I def i i /r> i \ 

On = mm Oo , q = max IqA. (z.l) 

l<j<d l<j<d 

In what follows we shall always assume that the form is non-degenerate, that is, that 
go > 0. 

Using the matrix defined in the introduction let Lq =^ (5+^^ G GL((i, M) denote 
the positive definite symmetric matrix with Lq = Q^. 

For r > we consider as a special class of regions Q the 'rescaled' boxes rfl =^ Cr 
{Lqx G M.'^ : \x\oo < t}, where |-|oo denotes the maximum norm on Mf^, and 

^=1' H^^'' ^=^' Ea,b n Cr. (2.2) 

We want to investigate the approximation of the lattice volume of Hr by the Lebesgue 
volume. Hence we estimate the following relative lattice point remainder of hyperbolic 
(or elliptic) shells in Cr for r large. Define 



AM 



volz Hr — vol Hr 
vol Hr 



(2.3) 



In order to describe the explicit bounds we need to introduce some more notations. 
Let (3 > 2/d such that < 1/2 - /3 < 1/2 - 2/c? for d > 4. For a lattice A C M.'^'^, with 
dim A = 2d and 1 < I < d we define its a;-characteristic by 

ai{A) =^sup||det(A')p^ : A' C A, /-dimensional sublattice of a|. (2.4) 

Here, det(A') = det(yl^ yl)^/^ where A' = AZ"^ and A denot es a {2d) x rf-matrix. 
Introduce 

7[T_,T],/3(r) = sup { (r-'^a,(Ai))'^'"'' : T„ < \t\ < T}, (2.5) 

where Af = drUtAq denotes a 2(i-dimensional lattice obtained by the diagonal action 
of dr,Ut G SL(2,]R) on (R^)'^ defined in (I5.19P and Aq denotes a fixed 2(i-dimensional 
lattice depending on Q introduced in (I5.18p . 

With these notations we state a result providing quantitative bounds for the differ- 
ence between the volume and the lattice point volume of a hyperbolic shell. 

Theorem 2.1. Let Q denote a non- degenerate d- dimensional indefinite form, d > 5, 
with go > 1- Choose /3 = 2/d + 6/d for some arbitrary small 6 G (0, 1/10) and let 

(; =^ d{l/2 — P) = d/2 — 2 — 5. Then there exist constants Cq > Qand a{d) depending 
on d only such that, for any r > q> qQ> 1, h > a and \a\ + \h\ < Cqt"^ , we have with 
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{b — a)* =^ min(6 — a, 1) and for any (logr)^ s<l/9,0<w<{b — a)*/8 

def volz H{r) _ 
~ ' vol H{r) ' 

< a(rf){e+-^ + (loge-Y(^Q%3^+r-'/'e(r,6-a))}, where 

Ph,t-ajr) inf{log(^^^)7[T_,T,],,(r) + CQ(6-arTl :T_e[l/r,l]} 

9 , / b — a ^ 
log(H ) . , x2 

=^ |det anc? cq =^ |det Ql"'^/'^"^/^ as tt'e//. Here we denote by A B 

quantities of equivalent size (up to constants depending on d only), 
i.e. A-^dB -^d A. 

Remark 2.2. The bound in Theorem 12.11 holds for inhomogeneous quadratic forms 
+ 'C] uniformly in |,^|oo < 1 as well. 

Our techniques apply, using the 7[T_,T+],/3-characteristic of irrationality used above, 
for positive forms as well. Simplifications arise from the fact that only the u;-smoothing 
of Ea^b has to be calibrated with other parameters of the error bound. Here we shall 
choose a special region rVt = Cr in such a way that the lattice points in Ea^ are 
contained in Cr and will be counted with weights 1 using the e-smoothing of the 
indicator of Cr, in fll.l6p with e = 1/16. 

Corollary 2.3. Let Q denote a non-degenerate d- dimensional positive definite form 
with d > 5, and Qo > 1. For any b > q > Qq > 1 and r = 2b^^'^ we have 

Ivolzi^r - volif,| <d r^-'pgW + \detQ\~'/^r''/Hogr, (2.6) 

where 

PQ(r)'=^^nf{log(r-ig)7[T_,T+],^(r) + CQri : T_ G [r-\l]], (2.7) 
where T+ = BQTl'h{T^), Bq = |det gi^^^/^-z^) 

def / \ ^ 

h(T^) = I log(T_ g^^/^)'^g^/^ j . Furthermore, hmr-^oo pii^) =0, as r (and b) tend to 
infinity, provided that Q is irrational. This hound is related to the hound obtained in 
|Got04j . 

In the following we shall simplify the rather implicit bound of Theorem l2.1l for various 
choices of the interval length 6 — a > and (smoothing) parameters e, w and T which 
will be optimized depending on r. 

Remark 2.4. Note that in Theorem 12. II we have 

^(r, fe — a)^r, if b — a<r, ^(r, 6 — 0)^-7 log(r), if b — a > r. (2.8) 
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Corollary 2.5. With the assumptions of Theorem \2.1\ we have for b — a < 1 

with T+ h{T^)TZ'' and 

PQ,.-a(r) '='inf{|Iogr„r(7[T_,T,],/3(r)log +CQ(6-arr^) : 

T_ G [r"^ + r"i/^l]}. (2.9) 
For any fixed T > 1 > r_ and irrational Q it is shown in Lemma [5. Ill that 

lim 7[T_,T]./3(r) = 0, (2.10) 

with a speed depending on the Diophantine properties of Q. This imphes for fixed 
6 — a > that 

lim PQ,b-a{r) = 0. (2.11) 

r— >oo 

and hence lim = 0. 

r—>oo 

In order to get an effective bound we consider the following class of Diophantine Q. 

Definition 2.6. We call Q Diophantine of type {k,,A) if there exists a number < k < 1 
and a constant < A < oo such that for any m G Z there exists an M G M{d, Z) with 

inf \\M-mtQ)\\ >A\m\-'^. (2.12) 

te[i,2] 

Corollary 2.7. Consider quadratic forms Q[x] with matrix Q which is Diophantine of 
type (k,A). Choosing (5 such that fid = 2 + 5 for some sufficiently small < t] < 1/10, 

we have with /i =^ 1/2 — /3 = 1/2 — (2 + 5)/c/ and {h — a)* = min(6 — a, 1) 

PQ,i>^air) «,,.,^,Q (logr)2'^r-'^^ {{b - arf~''\ (2.13) 

where Ui = 2(1 — K)/{d + 1 + n), and U2 = l/{d + 1 + K)/fi, provided that r > 1 is 
sufficiently large and n > is sufficiently small (dending on d). Thus we conclude 
for sufficiently small and fixed 5 and 'good' Diophantine types (A, k) ( with sufficiently 
small fixed k > 0) 

A(r) «,,^,,,Q (logr)2'^r--i((& " a)*)""' + r-'^'^^r, b - a) (2.14) 

o , b — a ^ 
r2 log(l + ) 

^{r,b — a) = , where the implied constant in ( I2.14p can be explicitly 

determined. 



quadratic forms 12 

3. Fourier Analysis 

3.1. Smoothing. The first step in the proof of Theorem 12. II is the rewriting of lattice 
point counting errors \vol^ Hr — volH^l in terms of integrals over appropriate smooth 
functions. 

To this end we introduce a continuous approximation of the indicator function of 

Hr = Ea^b n Cr- 

Denote by /c a positive measure with compact support satisfying the assumptions 
k([—l, 1]) = 1 and |A;(t)| < exp{— c|t|^/^} for all t G M and a positive constant c, where 
k(t) is the characteristic function of the measure k (see |BR86| ). 

Let 1/9 > £ > and w > 0. Let k^ and k^ denote the rescaled measures k^{A) =^ 

k{e~^A) and ky,{A) = k{w-^A) for A G B\ We write ea = {e,...,e) G 

T {sd, w) G W^'^^ and let kr '= k^^d x ^to- Here k^^ == k^ x ■ ■ ■ x k^, d 

times, denotes the product measure on Mf^ x M. For x = {xi, . . . ,Xd+i) G let 

Br{x) =^ {y G W^^'^ : \{y — x)j\ < e,j = 1, . . . ,d,\{y — x)d+i\ ^ w} denote a box 
centered at x. We need the following lemma (which follows from |BR86| ). 

Lemma 3.1. Let /i and v he (positive) measures on M*^"*"^ and lete,w denote two posi- 
tive constants as above. Then for every bounded real-valued, Borel-measurable function 
f on M.'^'^^ we have 

J fdifi -u)\< max| J f^d{fx - u) * k^\ + J if+ - f^^)du, (3.1) 

where 

/+(x) sup{/(y) -.yeBAx)} and /"(x) (-/)+(x). (3.2) 



Specializing (13. ip to / = Icr^ia.b], a < b, and < 2w < b — a, s < 1/9 we obtain 

'to 
[a,b] 



Corollary 3.2. Introduce /[^^ = /[_(i±£),i±e]d * k^^d and g^, J?^y =^ Iia,b] * k^. 



Then we have 

\yoh<i{Cr n Ea,b) - V0lKd(a H Ea,b)\ (3.3) 



<sup*\ /[±,(^Qm/r)jp,,,](g[m])- / /[^.(Lq x/r)jp,,,](g[x]) rfx 



BsjWjTl 



where sup* denotes the supremum over the choices ±e and a' G [a — w,a + w], b' G 
[b — w,b -\- w]. Furthermore we introduced 

Re,u,,r = J I (^Lqx/t e[l-2e,l + 2el Q[x]e [a- 2w,b + 2w]^dx+ (3.4) 
j i{Lq x/r G [0, 1 + 2e\, Q[x\ G [a-2w,a + 2w] U [6 - 2u;, 6 + 2w]^ dx. 
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Proof. Let A"^ denote the counting measure on Z'' and A'^ denote the Lebesgue measure 



on 



Consider the map T{x) 



def 



{T,{x),Ux)) 



def 



{Lq{x),Q[x]) for X e 



Denote by and the induced measures on M'^^^ given byA^(A) = A'^(T-M) 

and Af^(y4) =^ X'^{T~^A) for A G B'^^^. Using change of variables in the Lebesgue 
integral we obtain, 

V0l^d{Cr n Ea,b) - VOl^d^Cr H Ea,b) 

= X] ^hl,l]d(^Q"^A)/[a,^,](<5N) - y I[^i^i]d{LQx/r)I[a,b]{Q[x])dx 



f{s,t)d{Ai-xi), 



(3.5) 



def 



where f{s,t) =' I^_i^^d{s/r)I\^a,b]{'t), s G t G M. Using Lemma [XT] we obtain the 
estimate 



f{s,t) ci(A^-A^) 
where 



< 


max 


/ 




± 





and 



A2r f{s,t) 



def 
def 
def 



/^(s,t)rf(A^-A^)*A;, 



{s)L 



la+w,b—U}] (t) ) 



-^[0, l+2£] ( -s) -^[a- 2«;,a+2«;] U [b- 2w,b+2w] {t) + 

+-^[0,l+2£]<'\[0,l-2e]'*('5)-^[a-2«;],6+2«i](^)- 



The assertion of Corollary 13.21 now follows from (13. 5p and (13. 6p . 



(3.6) 
□ 



Lemma 3.3. The following bounds hold for any e G (0, 1/9) and \a\ + \b\ < cqt^, r > 
g^/^ (with a constant < Cq = Co((i) < 1/8 depending on the dimension only) 



R. 



'e,'w,r 



<d \detQ\^^/^{e{h-a)+w)r 



d-2 



YolHr >d |detg|-^/2(6-a)r 



d-2 



(3.7) 
(3.8) 



For a related hound to ([33]) see /^ |BG99] . 10^5, Lemma 8.2 or |EMM98| . Lemma 
3.8). Here we need an effective version in terms of Q. 

Proof. Assume that ^"^^^^^ < cq, where cq is an absolute constant to be determined 
later. Let Ji = Jo X [a, h]. For the bound ^ choose Jq = [1 - 2e, l + 2e\ = 1 1 2e with 



< e < ^. whereas for the bound (13. 8p choose Jq == [0, 1] x [a, b] 



Consider the region Vi '= vol{x G M'^ : (| loo/''', Q[a;]) G Ji}. Let U denote a 
rotation in M.'^ such that UQU~^ and hence ULqU~^ are diagonal. Changing variables 
via y = U^^Lqx/r in W'- with y e W x W,d = p + q,y = (1/1,1/2) and S^ly] = 
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^ — II 1/2 II ^ we may rewrite the region Vi as 

Vi = r'^\detQ\-^^Wi, where (3.9) 
V, yo\{yeR'':{\\Uy\Ur'So[y])e,h} 

= {yeR' : \\Uy\U G /o, So[y] G [a/r^b/r']}. 

Write y = (2/1,1/2) = (ri?7i, r2?72) with r/i G 5^, 772 G 5^ ||?7i|| = ||?72|| = 1 and ri,r2 > 0. 
By Fubini's theorem, we have 

00 00 

1^1 = y J rl~^r2~^I{rl — rl e [a/r'^,b/r'^])ip{ri,r2) dridr2, 


where 

V{ri,r2) = j /(||t/(rir/i,r2?72)||oo e Iq) dr]idr]2. 

SPxSi 

Note that, for \v\ < cq, v =^ — rf, m '= ri we have + r| = + f . In order 
to estimate Vi rewrite r2 = \Ju^ — v in terms of v. We have by change of variables 



fe/r2 ^ c{d) 

Fix, / 



/(n' > ^;)uP-V(«, V^I^^)(^/' - ^;)(«"2)/2 dv, (3.10) 

a/r2 ^0 ^ 

Proof of ( 13. Sp . Since here Jq = [0, 1], |?;| < Cq and n < cidi) we conclude that 

Fi >d (6-a)r"2, 

which proves (13. 8p . 

Proof of (13. 7p . Let [em^m = 1,. . . ,d) denote the standard orthonormal basis in M"^ 
and let {fm, m = 1, . . . ,d), fk = U~^em, be the transformed basis. Since 

nWUyWoo e h,2e) < j:i=i n\{yJrn)\ e Jo) we get 



d „ 

'^{ri,r2) <'^(Pm{ri,r2), where (Pm{ri,r2) = / /(^|((ri?7i, r2?72), /„) | G /i,2e) rf?7i 

m=l - - 



SPxSi 



Recall |t'| < Co,v = — r|,u = ri and r2 = \/u^ — v. Then the norm inequalities 
between || ■ ||oo and || ■ || imply (i(l + 2ef' >r\^r\ = 2u^ + v > [l — 2eY. Thus 

/ N n T / l-^e def {I + 2e)d 

(p[u, yu^ — v) = \) if < n < — ^— or m > c\d) = -= — . 

V 2 V 2 
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Since (1 - 2e)/v^> 1/2 we have as in f l3.10p 

fe/r2 c{d) 
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a/r2 ^1/2 

, b/r^ , c{d) 



m=l 



a/f^ 1/2 

Since y/u"^ — v < \Jv? + cq 1, we see that 

c(d) c((i) 
1/2 1/2 

We claim that 

Vi <d |detg|-^/2^(6 - a)/-2 (3.12) 

holds. In view of (13. 9p . (I3.10p and (I3.1ip . the estimates i?^ e for all m = 1, . . . , d 
together will prove the bound (13.120 . 

Thus let F.m{u) =^ |((m?7i, a/m^ - '^'72), /m)| for fixed < cq and (771,772)- If 

9 



9m 



-F„,(u] 



> ci > 



(3.13) 



for all i < n < c((i), then 



c(d) 

J(f„(m) e /i.2e)c^M< - 

Ci 



1/2 



and hence e for all ?7i = 1, . . . , d. Note that -^Fm{u) = ±((771, ^^".^ ^a), /m)- 



Furthermore, the function (^(t^) =^ — " satisfies the relations C(0) = and 

\C{v)\ < Co maxo<|^,|<co |C'(^)I- Since ('{v) = ^^ff !_~^3/2 , we get 

\A'f M / 2^2 + Co 
max \C [v) \ < ^ . „ TTTTT. 



Since h < u < c{d), we have 



> 



Fm(u) 



u 



\av)\ > 



l-e 



1 - Co- 



u + cq/2 \ 



-00)3/27* - 8m - 8c(d) 



for < Co < I sufficiently small. Therefore (I3.13P holds and the assertion (I3.12p is 
proved. This yields the desired bound for first integral in Re,w,r (see (13. 4p ). To estimate 
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the second integral in Re,w,r it remains to prove that 

V2 <d \deiQ\-^/^wr''-\ 
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(3.14) 



where V2 = vol{x G : (| U/r, Q[x]) E J2} and J2 = [0, l]x {[a-2w,a + 2w] U 
[b — 2w, b + 2w]). Using the previous arguments with some simphfications, we obtain 
the estimate (I3.14p (see |BG99| as well). The statement ( 13. 7 P of the lemma then follows 
from (KWf and (1334]) . □ 



Introduce the functions 



ij{x) = Lp(^^\\x\f^ exp{||x||^}. 



(3.15) 



Here (f = /[-2,2] * k denotes a C°°-function such that (f{u) = 1 if |m| < 1 and (f{u) = 
if |n| > 3. 

In order to introduce exponential convergence factors, rewrite II^^{Lqx /r) as follows 



Il±e{LQx/r) = x±e,r(a;)exp I - r ^Q+k]}, 



(3.16) 



where 



^] and for w,e > 



X±eA^) = Il±e{LQx/r)%l)[-LQx). 
Furthermore, in order to simplify notations write 

V;f^±^(r;a,6) =^ ^ exp -r"2Q+[x] gw{Q[x]^ X±e,r{x)dx (3.17) 

and 

K?±,(r;a,6) = j exp [-r^^ Q+[x]] g.u,{Q\x]) x±eA^)dx . (3.18) 



Using these notations. Corollary 13.21 and Lemma 13.31 yield the upper bound 

|vol^.(a n Ea,b) - volffi.(a n Ea,t)\ < max] Vj,^^, (r ; a, b) - V^^^^ir; a, b)\ 



±e 



+c{d) |detgr^/2(e(6 - a) + w)r" 



(3.19) 



4. Estimates by Theta-series 

We want to estimate the above errors by Fourier inversion and thus by integrals over 
theta functions. 
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For w G we introduce the following theta sum and theta integral 
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^v{z) = ^exp[-Qr,^{t,x)] 



def 



exp [—Qr,v{t, x)] dx, 



where Qr,vit,x) =^ r — it ■ Q[x] — i ■ (x,^). 

Note that 

^ min{|6 — a|, 1^1""*^} exp{— c|tu;|^/^}. 
Now we can rewrite the right hand side of fl3.19p as follows 



(4.1) 
(4.2) 

(4.3) 



V^^,{r; a, b) - Kj±.(r; a, 6) = / 9Ut)j^ j X±eAv) ■ {e.{t) - e,(t)]dv dt 



Consider the segments Jq '= ~] and Ji =' M \ Jq. We may split the integral on 

the right hand side as follows into terms 

yw,±e{'^-^ - Kj±.(^; I <<i ^o,± + /o,± + /i,±, say, where (4.4) 



def 



^1, 



def 



def 



def 



9w{t) / X±e,r{'^) ■ [Ut) - 0,{t)]dv dt 



Jo 



9w{t) / X±eA'") ■ dv{t)dv dt 



and 



Ji 



9w{t) / X±eA'") ■ dv{t)dv dt 



(4.5) 
(4.6) 
(4.7) 



Ji 



Before proceeding with the estimation of the terms /o,±, we shall collect pointwise 
bounds of theta series and integrals in the following Lemmas using Poisson's Formula. 
Furthermore, we need bounds for integrals of X±£~r- Starting with the latter we have 



Lemma 4.1. The following estimates hold 



\x±e,r{v)\dv < c{d){\og-Y and 



e 

1 1, 



\x±sA'>'')\dv < c{d,k)^{\og-y 



(4.8) 
(4.9) 



\\Lq^v\\\^>R 



for arbitrary large /c G N and for all R such that R{logR) ^ > c{d)k'^e ^ with a 
sufficiently large constant c{d). 
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Proof. We shall prove this lemma for the function x+e,r- One can prove the assertion 
of the lemma for X-e,r in the same way. Note that by definition (13.161) 




\XeA'^)\ = / \If^^i!{v)\ dv = / I / I[^^{v - x)i/j{x)dx\dv. (4.10) 



Hence J \xe,r{v)\dv < where ||/||p denotes the p-norm, p G [l,C)o], of 

f with respect to Lebesgue-measure. Since \Di^ . . . D'^'^ip{x)\ < c{d,ai, . . . ,ad), we 
easily conclude that 

< c(rf,A;)(l+ xeR'^ and (4.11) 

^li < c{d). (4.12) 



Thus we have 

^ r ^ / r sin —{\-\-e\v ^ \ 

\Il^,{v)\dv= / |/[_(,+,),i+,].(tO||M^)M^<c%/ '\ \k{ev)\dv) < 



1+ j j^\k{ev)\dvy <c''{l+ j ^^e-''\''\"^' dv^ <c\\og^Y. (4.13) 

|i'|>l |»;|>ei/2 

We obtain the estimate (14. 8 p from (I4.12p and (I4.13p . Furthermore, 

j \Xe,r{'")\d^ 
\\Lq\\\^>R 

< j \Il^^{v — x)\\ip{x)\ dx dv + j \IIj^^{v — x)\\ip{x)\dxdv 

\v\\ac>RA\x\\oo<\R \v\\oc:>R,\\x\\oc:>\R 

< I \iu,{v)\dvmi + \\iUe\\i f mx)\dx. (4.14) 



\v\\^>^R \\x\\ao>^R 

By (14. lip , we have 

J \;i;{x)\dx<c{k)^. (4.15) 



\x\\cx>>^R 
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Repeating the argument which we employed in the proof of f l4.13p . we arrive at the 
following bound, (for j^^p-^ > ^ and k > cd with sufficiently large c > 0), 

/■ - / f sm-(l + e)v - \<i-i f 1 ^ 

J \F^+^{v)\dv < c{d)\^j -\k{ev)\dv^ J —\kiev)\dv 

\v\\^>^R IK \v\>R/i2d) 

< c(rf)(logi)V^W(^^)^'' <c(d)(logi)'^i^. (4.16) 

The assertion of the lemma follows directly from ( 14.141) and ( I4.12p . fl4.13p . f l4.15p . 
and ( Km . □ 

Concerning estimates of 6^ — 9^ we have 

Lemma 4.2. (Poisson's formula) For a symmetric, d x d complex matrix Q, whose 
imaginary part is positive definite the following holds: 

exp^^niQ[m]+2ni{m,v)^ = (^det(^— " ^ exp|-7rifi^^[n + (4.17) 

The term with n = of the series over n is given by 

j exp{7rzri[x] + 27rz(a;,i;)}(ix = ^det ^— exp {-vrz ■ ri~^[t;]} . (4.18) 

Here s G M°' and VL~^\x\ denotes the quadratic form {Q~^x,x), defined by the inverse 
operator Q^^ : — ?■ (which exists since Q is an element of Siegel's generalized 
upper half plane). 

Proof. See |Mum83| . p. 195 (5.6) and Lemma 5.8. □ 

Lemma 4.3. Let 6y{z) and d„{z) denote the theta sum and the theta integral introduced 
in (14. ip and (14. 2 p respectively, that is 

9v{z) =^ exp [—Qr,v{z, x)] and (4.19) 



e,{t) = I exp[-Qr,,{z,x)]dx, (4.20) 



where Qr^v{z,x) =^ r ^Q+fa;] — itQ[x] — i ■ (x,-). 



Let t G M, |t| < :^ and r > 1, then the following bound holds 
\{O.-0v){t)\ 

«d |r-2 + (exp {- Re((r-2 + tty') } + \detQ\-'/' I^^,/^y,^^^{\Q:,'/\\)y 
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Proof. Using Lemma 14.21 with Q =^ ^'^tj where Qt = r "^Q^ + itQ is a selfadjoint 

(4.21) 



operator, we get by fl4.17p and f l4.18p that 



neZd\{0} 



Note that S Q+^Q is a reflection (with eigenvalues ±1) and Q, Q^, S commute. Thus 
we obtain Qt = Q^{r~'^ + itS). Diagonahzing these operators, we get det (^TT~^Qt 

det(7r(5+) • l^;]'^, with z == + it and hence 

/ 1 ~ \ -1/2 
det [TT'^Qi 



< |det(7rg)|-i/'|2r^/l (4.22) 
Similarly write 

Hence, we get an inequality for positive symmetric matrices Iie{z~^) Iie{Q^^) > Q^^ 
which implies 

exp{-n'Q;'[n-^]}\ = exp{- Re (g-^ [vrn - |-] ) } 



< exp|-Re(2-i)g;i[7rn-|-] }. (4.23) 



Using IK21\\ and IK23\\ we get 



{9,~e,)it)\<^, \detQ\-'/^\z\-''^' ^ exp{-Re(^-i)g;i[7™-|-]}. (4.24) 



neZd\{0} 



For all ||g_|_ f II < Tir jc^l'^ and n ^U^\ {0} we obtain 



TT 



Thus (14:241) yields 

[Q.-Q^){t)\ <rf |2|-''/2gxp|_j^g(^-i)^|^ ^l^g^g ^425) 



def 



16g. 
16z' 



K = |detg|-V2^exp{-Re(^)g;^[^ 
Let / = [-|, i]'^. Then Q+^[x] < 1, for x G J, go > 1, and 



n\ 



(4.26) 



y exp{— g^^[m + x]/2}(ix > exp{ — g^"'^[m]/2 — (i/2} y exp{ — {Q^^m, x)}dx, 
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where the integral on the right hand is larger than 1 by Jensen's inequality. Thus 
if Re(f^) > 1/2 (which follows from Re(l/(r-2 + it) = rV(l + tV^) > A/ir^ since 
\t\ < 1/r) we obtain 

K<^dYl 1^^* ^1^'^' / eM-Q+'[x]/2}dx <rf 1, (4.27) 

which proves Lemma [4.31 for < ixr/q^/'^ . Otherwise, set v = Lirr + v' , with 

L e Z'^, < 7rr/g^/2_ (ICTl) we obviously have 6^ = 9^, and therefore 

\{e,-e:){t)\ < \{e,,-eoy)it)\ + \{eoy-eo,,)it)\. (4.28) 

Since by (KT2\i |6'oy(t)| + \Oo,v(t)\ <d \detQ\'^^^'^\z\~'^/'^ the Lemma is proved in view 
of dOSD and iK27} . ' □ 

We now return to the error integral terms in (14. 4p . First we shall estimate the volume 
approximation term Iq. 

Estimation of /o,±: First we derive a bound for /o,+ . For t & Jq we obtain, using 
Zt =^r~^ + it and Lemma [4.31 



<rf Qt,i + 0i,2, say, where (4.29) 



XsA^') ■ {o,it)-e,{t)}dv 

0t,i = ktT^exp {-Re(2;7^)} / \XeA^)\dv, and 

detgr^/^lzr'/' / \XeA^)\Ii^r/,^f^oo){\Q+^M)dv 



'-'t,2 — 



Since \zt\ = r~^(l + r^t^)^/^ and Re(zj~"'^) = y+^^ may rewrite Bf^i via s = 

(1 + r^t^)~^ and the function /i(s) == s'^^'^ exp{— sr^}. The maximal value of h 

on [0, oo) is attained at sq = bounded by (r~^)'^/^ up to a constant 

depending on d only. Hence we get by Lemma 14.11 

supGt,! <d r'^suph{s) \xeA^)\dv <t:d r"^ (rn / \xeA^)\dv 

teJo S>0 jRd V / J^d 

«, r'/'{\oge-'f, (4.30) 
and similarly by Lemma [4. II with R = nr/q^^"^ we have 

sup 6^,2 (log£-i)'^|detgri/2(gV2/^)/c|^^|-d/2 (log5-i)'^g'=/2|detgri/V-^+'^ 

teJo 

r'^/2|detg|-i/2^1og£-i)^ (4.31) 
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provided that we choose k = d and r > q. Thus we conclude by (I4.29p . (l4.30p and 

dMH) 

supGt <,r^/2(log5-i)''. (4.32) 

teJa 

Integrating this bound over t G Jq with weight we get 

1 1 

r r 

|/o,+ | < j Qtdt<^dr'^''^{\oge-^Y j m.m{{h - a),\t\-^}dt. 

— i — i 

r r 

Thus we conclude 

IVI <^Aog{l + \h-a\r-^VI^{\oge-y. (4.33) 

It is easy to see that the bound for /o,_ is of the same form. 
Estimation of /q_|_: By (14.18^ with Vt =^ ^Qt, where Qt = r~'^Q^ + itQ, we conclude 
that \Ov{t)\ in (|42]) may be estimated as in fl423l) and (l422l) (with n = 0) 

\Ut)\ «, \detQr'/'\zt\-'/'exp{-Re{z^')Q-'[^]}. 

Thus we obtain using Lemma [4.11 



T* 



/oo 



Note that for r^s > 1 we have 

Since |^u;(t)| < min{|6 — a|, Itl""*^} exp{— c|wt|^/^} we obtain for the case |6 — a| < r 
using f l4.34p for s = 1/r and s = r/\b — a\, splitting the t-integral into the parts 
i < |t| < r/\b - a\ and |t| > r/\b - a\ 

/o*± <d (loge-^)'^min{|6-a|,r}r-^|detg|~^/V'^/V-^ (4.35) 

provided that d > 2. Inequality (I4.35P holds as well in the case \b — a\ > r by similar 
arguments. Note that combining fl4.33p and (I4.35P we obtain in view of |det(5| > 1 

|/o*±| + IVI «d (loge"^)'^ log(l + |6- a|r"i)r^/2. (4.36) 

By means of fl3.3p . fl3.7p . (14. 4p and fl4.36p we may now summarize the results obtained 
so far as follows. For any 1/9 > e r~-'^(logr)^ and \a\ + \b\ < CqT^ we have 

V0h{Hr) - VohiHr) <d SUp*(Ji,±, /o,±, /o,±) + Re,w,r (4.37) 

<d sup*Ji,± + (loge-^fr'^^^ \og{l + \b-a\r~^) + \det Q\~^/\e {b - a) + w)r'^-\ 
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where sup* denotes the sup over ±e and a' G [a — w,a + w],b' E [b — w,b + w] and 
h,± = 



9w{t) / X±eA'^Wv{t)dv dt 
<d \gAt)\ sup \9^{t)\dt, 



(4.38) 



in view of Lemma 14.11 

Estimation of Ii,±: We shall estimate Ji +. The bounds for Ji „ have the same form 
and are proved in exactly the same way. In the sequel we shall therefore Ji instead 
of This is the crucial error part. At first we shall bound the theta series 6'^,(^) 

uniformly in v by another theta series in dimension 2dm order to transform the problem 
to averages over functions on the space of lattices (subject to actions of SL{2,'R). We 
have 

Lemma 4.4. Let 9^{t) denote the theta function in (I4.19P depending on Q andv G C^. 



For r >1, t G 



the following hound holds 
\0^,{t)\ <d (detg+)-^/V'^/2^(r,t)^/2^ where 
ip{r,t) =^ exp{~Ht{m,n)}, and 



Ht(m,n) 



def 



r^Q-^[m - -tQn] + r~^Q+[n] 



(4.39) 
(4.40) 

(4.41) 



and Ht{m,n) is a positive quadratic form on 1?'^ . 

Note that the right hand side of this inequality is independent of i; G 
Proof. For any x,y G M'^ the equalities 

2 {Q4x] + Q4y]) = Q+[x + y] + Q+[x-y], 

{Q{x + y),x-y) = Q[x] - Q[y] 



(4.42) 
(4.43) 



hold. Rearranging 6v{z) 9y{z) and using (14. 43 p . we would like to use m + n and m — n 
as new summation variables on a lattice. But both vectors have the same parity, i.e., 
m + n = m — n mod 2. Since they are dependent one has to consider the 2"^ sublattices 
indexed by a = (ai, . . . , ad) with aj = 0, 1, for 1 < j < d: 

def 



where, for m 
Thus writing 



mi. 



Z"^ = {meZ"^ : m = a mod 2}, 
rrid), m = a mod 2 means rrij = aj mod 2, 1 < j < d. 



9v,ait) 



def 



exp 



2 V 
—Q+[m] - it ■ Q[m] + i ■ {m, -) 
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we obtain 6y(t) = ^a^-",a{t) and hence by the Cauchy-Schwarz inequahty 

\Ov{tf < 2'^5Z (4.44) 

a 

Using f l4.43p and the absolute convergence of 6*0, (t), we may rewrite the quantity 
Ov,a{f) Ov,a{t) as follows: 



■{Q+[m] + Q+[n]) - it ■ {Q[m] - Q[n]) - i ■ {m - n, -) 



J2 

m.ni 



— -{Q4m]+Q4n]) - 2i ■ {2t ■ Qm + -,n) 



(4.45) 



m + n _ m — n 

where m = — - — , n = — - — . Note that the map 



2 ' 2 
H : [j^Zi X Zi Z'^ X Z^, (m, n) 

get by fl444l) 



m + n m — n 



is a bijection. Therefore we 



1^.(^)1 



5Z 5Z ^^p 

q6{0,1}'* m,ne1i 

2 



-r-^{Q4m] + Q4n]) - 2i ■ {2t ■ Qm + -,n) 



exp 



(Q+[m] + Q+[n]) - 2i ■ {2t ■ Qm + -,n) 



(4.46) 



In this double sum fix n and sum over m ^ Z^ first. Using Corollary 14.21 for 

def — - 

(iQ+r""^ + tQ)/iT, we get for 5 = (det ■ Q+)) ^ by the symmetry of Q 



^^p 

(5 ^ exp 



- — (g+[m] + Q+[n]) -2z- (2t-Qm + -,n) 



-^g;^[7rm-2tgn] - ^Q^n] - 2t{-,n) 
2 r 



Thus, 



\e.{t,n)\ < 5 Y exp|-^Q;i[7rm^ - 2tQn] - ^Q+M}- (4-47) 
Hence, we obtain by and f lOTj) 

|^.(t)r<d(detg+)"i/V^ ^ expl-GiKn]}, 
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where Gtlrriju] '= '^QZ^[Ti'm — 2tQn] + -^Q+ln]. Since 7r^/2 > 1 we may bound 
Gt[m,n] from below as follows: 

2 

Gt[m,n] > r'^Q+[m tQn] + r~'^Q^[n] = Ht[m,n], 

TT 

which proves Lemma [4. 4[ □ 
Lemma 4.5. Let A be a lattice in M'^. Assume that < e < 1. Then 

exp{-£}#i/ < ^exp{-£|K;f } s~'^'^ i^H, (4.48) 

?;eA 

where H =^ {f G A : ||t;||oo < l}- 

Proof. The lower bound for the sum is obvious by restricting summation to the set of 
elements in H . As for the upper bound introduce for /x = (/ii, . . . , /i^) G Z*^ the sets 



such that M°' = U/^ -^m- For any fixed w* e H^^ = {w e Af] B^^j we have 

w — w* E H, for any G if^. 
Hence we conclude for any /i G Z'^ 

Since x E B^ implies ||a;||oo > ||At||oo/2, we thus obtain 
^exp{-e ||t;f } < ^exp{-e 

< #i/o+ 5^ 5^l{t;G5^}exp{-|||/i||L} 

This concludes the proof of Lemma 14.51 □ 

5. Functions on the space of Lattices and Geometry of Numbers 

Let n G and let Ci, 62, . . . , be / < n denote linearly independent vectors in M". 
Let A be the lattice of rank I generated by all integer combinations of these vectors. 
Then the determinant of the lattice A, denoted by det(L), is given by det((ej, ej),i,j = 

1, . . . lY^"^- It does not depend on the choice of the basis of A, . 

More generally, for applications in the next section, for every /, 1 < / < n, we fix 
a quasinorm | ■ |; on the exterior product a'M". Let A be a lattice in M". We say 
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that a subspace L of M" is ^-rational if L fl A is a lattice in L. For any A-rational 
subspace L, we denote by d^{L) or simply by d{L) the quasinorm |ni A . . . A n^l^ where 
. . . , Ui}, I = dim L, is a basis of L fl A over Z. If {vi, . . . , t;/} is another basis of 
L n A, then Ui A . . . A Ui = ±Vi A . . . Avi. Hence d{L) does not depend on the choice 

of basis in L n A. For L = {0} we write d{K) =^ 1. If the quasinorms | ■ |j are norms 
on A'M" induced from the Euclidean norm on M", then d{L) is equal to det(L), that is 
to the volume of fl A). In particular, in this case the lattice A is unimodular iff 
o?a(IR") = 1- Also in this case d{L)d{M) > d{L n M)d{L + M) for any two A-rational 
subspaces L and M (see Lemma 5.6 in |EMM98] ). But any two quasinorms on a'M" 
are equivalent. This proves the following: 

Lemma 5.1. There is a constant C >1 depending only on the quasinorm \-\i and not 
depending on A such that 

C'^d{L)d{M) > d{Lr] M)d{L + M) (5.1) 

for any two A-rational subspaces L and M . 

Let us introduce the following notations for < / < n, 

def 1 

a;(A) = sup{ : L is a A — rational subspace of dimension /}, (5.2) 
d{L) 

a{A) =^ max ai{A). (5.3) 

0<l<n 

This extends the earlier definition of ai{A), see ( 12. 4p . of Theorem 12.11 to the case of 
general seminorms on A*M". In this section the functions ai and a will be based on 
standard Euclidean norms though, that is, they use d{L) = det(L). 

In the following we shall use some facts in the geometry of numbers (see Davenport 
(1958), |Dav58| or Cassels (1959) and classical reduction theory for lattices in M", 
|Cas59| ). They show that the number of points from A in the unit ball in lies 
between two positive constants, (see Corollary 15. 71 below). 

Let F :— > [0, oo] denote a norm on M". The successive minima Mi < ■■■ < M„ 
of F with respect to a lattice A in are defined as follows: Let Mi = inf|F(m) : 
m 7^ 0, m G a} and define Mj as the infimum of A > such that the set |m G A : 
F{m) < a} contains j linearly independent vectors. It is easy to see that these infima 
are attained, that is there exist linearly independent vectors bi, . . . ,bn G A such that 
F{bj) = Mj, J = l,...,n. 

Lemma 5.2. Let Fj{m), j = 1,2, be some norms in M" and Mi < ■ ■■ < M„ and 

Ni < ■ ■ ■ < Nn be the successive minima of Fi with respect to the lattice Ai and of F2 
with respect to the lattice A2 respectively. Let C > 0. Assume that Mk C* -^2(^/0); 
k = 1,2, . . . ,n, for some linearly independent vectors 61, 62, • • • , &n G A2. Then 

Mk:^nCNk, k = l,...,n. (5.4) 
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The proof of this lemma is elementary and therefore omitted. 

For a lattice A C M", dim A = n and 1 < I < n recall the definition of ai- 
characteristics by 

a;(A) =^ sup| I det(A') I ^ : A' C A, /-dimensional sublattice of A.| (5-5) 

Lemma 5.3. Let F( ■ ) he a norm in M" such that F{-) x„ || ■ || . Let Mi < ■ ■ ■ < M„ 

be the successive minima of F with respect to a lattice A C M" of rank n. Then 

ai{A)-n{Mi- M2---Mi)-\ l = l,...,n. (5.6) 

Suppose that 1 < j < n and Mj < fi < Mj+i, for some /i > and Mn+i = oo. Then 

G A : F{v) < /i} x„ /i^(Mi ■ M2 ■ ■ ■ Mj)-\ (5.7) 

For the proof of (15. 6p in Lemma 15.31 we shall use the following result about reduced 
lattice bases formulated in Proposition (p. 517) and Remark (p. 518) in A.K. Lenstra, 
H.W. Lenstra and Lovasz (1982), |LLL82j . 

Lemma 5.4. Let Mi < ■ ■ ■ < M„ he the successive minima of the standard Euclidean 
norm with respect to a lattice A C M". Then 

Mi^dWeiW, / = l,...,n. (5.8) 

Moreover, 

n 

det(A) x„ (5.9) 

Proof of Lemma 15.31 

Proof of (15. 6p .'. According to Lemma |521 we can replace the Euclidean norm || ■ || by the 
norm F{-), in the formulation of Lemma Let A' C A be an arbitrary /-dimensional 
sublattice of A and Ni < ■ ■ ■ < Ni he the successive minima of the norm F{-) with 
respect to A'. It is clear that Mj < Nj, j = 1,2, ... ,1. If Mj = F{bj) for some linearly 
independent vectors bi,b2, . . . ,bi G A and 

I 

^' = -n, = l,2,...,l'j, 

i=i 

then Mj = Nj, j = 1,2, . . . ,1. It remains to apply Lemma [5.41 

Proof of (15. 7p . Let ai denote the elements in A corresponding to the successive minima 
Ml, I = 1, . . . ,n. For any f G A with F{v) < Mj < /i we have by definition 

V = mi ai + . . . + rrij Oj 

with some rrij G Z. Since for |m/| < ixF[ai)~^ , / = 1, . . . , j we have F[v) < /x we 
conclude that 

N{^J) = G A : F{v) < /i} >„ /i^(Mi ■ M2 ■ ■ ■ Mj)-\ (5.10) 
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For the upper bound (see e.g. Davenport |Dav58| ). For convenience we include the 
short argument here. Define positive integers i/i, . . . ,Uj such that 

2^«-i < ^ < 2''\ (5.11) 

Hence, Ui > V2 ■ ■ ■ > ^i- Consider another element G A with F{v') < fi and 
v' = m[ ai + . . . m'j aj with some m'j G Z. Assuming for the moment that mi = m[ 
mod 2""', / = 1, . . . , j, and let i denote the largest index i such that rrti ^ m'^. Then 

X '= 2~^' {v — v') is an element of A and linearly independent of ai, . . . , aj_i. Thus we 
conclude F{x) > Mi. But 

F{x) =2-''^F{v -v') <2~'''{F{v) + F{v')) <2"'^' 2/i<M, 

by (15. lip . The contradiction shows that there is at most one lattice point in A such 
the coordinates mi, . . . , mj lie in the same residue classes to the moduli 2*^^, 2''^, . . . , 2'^^ 
respectively. Hence the number of lattice points N{fi) in (I5.10p is bounded from above 
by the number of all residue classes, i.e. by 2''^2'"' . . . 2"^ < (4/i)^(Mi . . . M,)"^. This 
shows the upper bound in (15.70 . □ 



Lemma 5.5. (Davenport |Dav58) . Minkowski) Let k = AIT" and A' = A! IT" denote 
dual lattices of rank n, i.e. det(A)det(A') = 1 and {Au,Av) = {u,v) for any vectors 
u, i; G Zi" or AA''^ = /„. Let Mj,j = 1, . . .d, and Nj,j = 1, . . .n, denote the successive 

minima of A resp. of A' with respect to Euclidean norm \\-\\. Let c^{n) =^ {n\)~'^2^ /un 

and c+ == 1^ jiiJn where Un denotes the volume of the unit n-hall. Then we have 

c_(n)det(A) < Mi ... M„ < c+(n) det(A), (5.12) 
c„(ri)det(A') < iVi . . . iV„ < c+(n)det(A') (5.13) 

1 < M,Ar„+i_,. < c+(n), j = l,...,n (5.14) 

Proof. The first two inequalities are special cases of Minkowski's inequality for the 
successive minima of arbitrary norms F on A 

2« 2"' 
det(A)— - <Mi...M„ < — det(A), (5.15) 
n\V V 

where V denotes the volume of the convex body F <1. By the unimodularity and the 
choice of F we have V = Un- The left hand side of fl5.14p follows by the definition of 
the successive minima Mj and Nn+i_j and the existence of u resp. v in sublattices of 
rank j resp. n + 1 — j of A resp. A' such that (u, 7^ that is ||f || > | (m, f ) | > 1. 
The right hand side follows by Minkowski's inequalities for both successive minima. 
For details, see (Davenport (1958). (I)av58] . Lemma 2) □ 
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5.1. Conjugate lattices. Now we shall apply the previous results to the special norms 
Ht{m, rriY^'^ in the theta series fl4.40p . Here and below writing (a, b), for a G M'^, b G M.'^, 
means that (a, b) G M^*^ and the coordinates of (a, b) are the coordinates of the vectors 
a and b in the corresponding order, that is, (a, b) = (oi, 02, ... , a^, bi,b2, ■ ■ ■ , bd)- In the 
following we shall use methods from the Geometry of Numbers for lattices in M" with 
n = 2d. Recall that Ht is a positive quadratic form on M.'^ x M*^ given by 

Ht[m,m]=r^Q-^[m-t'Qrh]+r^Q+[m], t' = -t, t G M, r > 1. (5.16) 

Let (■,■)( denote the associated scalarproduct =^ Ht{l),l G M'^ x i?'^. We shall 

rewrite //^[m, m] by means of elements of SL{2d,M.) and lattices in M^'' as follows. 

Introduce for (m, m) G Z^"^, u =^ Q^^^^m G M'^ and =^ Q+^^^Qrh = SQ^/^m G M"^, 
where S = QQ+^ is a reflection. Note that 5, Q and (5+ commute. Let T G 
S'L(2(i, Z) be the permutation matrix which reorders the 2d coordinates [u, v) = 
{ui, . . . , Ud, fi, . . . , frf) G M^'^ into d pairs given by 

T(u,tO =^(?7i,...,?7rf), where r]j = {uj,Vj), 
Let Aq denote the lattice of rank 2d of all vectors T{u, v) 

Kq'^TAqI?^ where Aq'^ { 

Note that det(AQ) = 1. Thus we may write Ht[m.,ffi\ = r^\\u — t'vW^ + r~^||t;||^ = 
Yl'j=i\\drUtr]j\\'^, where 

dr = ( ) ' = ( / ) • ^^-^^^ 

Here D =^ {rfr,''" > 0}, and U == G M}, are quasi-geodesic and unipotent one- 

parameter subgroups of 5'L(2,M). We shall consider the diagonal representation of 
g G SL{2,R) on {R^ = R^^ defined by 

g{r]u...,Vd) = {9Vu---,9Vd). geSL{2,R),. (5.20) 

Denote in particular the representation of g = dr and g = Ut on (R'^Y by the same 
symbols g, dr and Ut- Thus we may rewrite (15.161) as follows 

Ht{m,rh) = r'^\\Qj^^^'^m — t' S Q]^'^rh\\'^ + r~^\\Q^_l'^rh\\'^ = \\drUtT AQ{m,rh)^\Y 

= WdrUtvf, where r] = {r]^, . . . ,r]d) e {RY. (5.21) 

Note that in view of (15. 5p the archaracteristic of the 2(i-dimensional lattice =^ 
drUfAq may be expressed by the reciprocal of the minimal volume of a /-dimensional 
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sublattice, generated by elements, say Oj = drUtTAqlj, where Ij is a basis of an l- 
dimensional sublattice of 1?'^. Thus 

1/2 



ai{At) = det(^{aj,ak),3,k = l,...,d^ . (5.22) 



By construction {aj,ak) = {lj,lk)t- 

Based on the special symplectic structure of our 2(i-dimensional lattices we may sharpen 
Lemma [5.31 and Lemma [5.51 as follows. 

Lemma 5.6. Let Mi, . . . , M2d the successive minima of At = drUtAq with respect to 
the norm \\-\\. Then we have for any t and fi > 1 

MjM2d+i^j 1, J = l,...,rf, (5.23) 

r-'g^ < Ml < ... <M, <,1 <M,+d, j = l,...d, (5.24) 

e At : < fi} //^^(Mi ■ M2 ■ ■ ■ M^y' fi^'^a^iAt). (5.25) 

Corollary 5.7. Notice that 

a{At) = max{a,(At) : j = 1, . . . , 24 ^^(Ai). (5.26) 

Proof. First we prove fl5.23p . Let J =^ k-,r/2 denote the imaginary unit in 5*1/(2, Z). 
Then we have the following obvious relations 

J kg = kg J, drJ=Jdr~i, uj J = J U^t, cLIld 
dr Ut = Utr2 dr. (5-27) 

For B e GL{d,R) define Jb G SL{2d,R) as: 

Jb = (^J ~n)- (5.28) 



^ B Oa ^ 

Using the reflection S G Gl{d,R) defined above define 

At = drUtAQ = drUtTAQZ^'^ and A'/= drUtT AqJsZ'^'^. (5.29) 

Note that these lattices are adjoint with repect to the diagonal action of J on (M^)*^. 
To see this let for any A^, A^' G Z^'^ 

w{N) = drUtTAQN G At, wj{N') = J drUtT Aq{-Js)N' G A;. 

Using (15:771) together with JT = TJj, T G 0(2d), AqJiAq = Js and J| = -Id we 
obtain 

{wiN),wjiN')) = {N,N'), (5.30) 

for any A^, A^' G Z^'^. Hence At and A^ are dual in the sense of Lemma [5.51 We claim 
that they have identical successive minima. To this end note that with 
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+ 



m] 



= \\{Ql'^^Sm-t'Q~'^^QSm,Q'fSm)\\ = \\w{{-Js)JiN)\\ 

= \\w'{JiN)\\, (5.31) 

where we have used {—Js)Ji{m,m)'^ = {Sm, Srh)'^ and in the last equahty ||Jw|| = 
\\w\\. Since Jil?"^ = Z^*^, the equation fl5.3ip imphes that the successive minima of 
and are identical and by Lemma [5.51 we conclude MjM2d+i-j 1 for j = 1, . . . , ci. 

Proof of (K2M . Since Ma < Md+i and 1 -C^ MdMd+i <d 1 we obtain Mj < Md <d 
1 '^d Md+i < Mj^d for all j = l,...,d. The inequality Mi > q\^'^r~^ immediately 

follows by definition of the first successive minimum and ^^t-H > Q'o^^'""^- 

Proof of fl5.25p . Let 2d > j > 1 denote the maximal integer such that Mj < b. 
Then Lemma [5.31 yields with /i > 1 

#{v G At : \\v\\ < /i} < (Ml . . . M,)-i fi^^iM^ . . . Md)-\ 

since in the case j > d we have Mj > ... > Md 1 and in case j < d we obtain 
fi < Mj+i < . . . < Md 1. The last inequality in (I5.25P follows by Lemma [5.31 and 
the corollary is immediate by the last arguments (with /i = 1). □ 

For arbitrary t and for small t the following bounds which are independent of the 
Diophantine properties of Q hold. 



Lemma 5.8. Let qj"^ < Nq^i < Nq^2 < • • • Nq^d < 9^^^ denote the 
of the lattice A =^ Q^^Z'^. We have 



successive minima 



syxpad^dsUtKo) <d ^q{s), where (5.32) 
t 



/|detg|-^/2 W (^^),s>0. Note that 



<d s-^|detQ|^/^ if |s|<gJ/^ and (5.33) 
<d /|detQ|-^/2^ if \s\>q^/^ (5.34) 



For small t we get 

adidrUtAq) <d \det Q\^/^r-^ + \tr\Y, if q'J''\tr\ > I, (5.35) 
adidrUtAg) <d |detQ|-i/2|^r|-^ if q'/''\tr\<l. (5.36) 

Proof. By Lemma [5.51 relations ( 15. 7p and f l5.25p with /i = 1/2 we conclude that 

ad{At) -d (Ml . . . Mdr' -d #^ G Ai : ||t;f < 1/4}. (5.37) 
Recall that \\v\\^ < 1/4 with v e At (see ([STTG]) ) may be written as 

i7t[m,m] =r2Q;^[m-t'Qm] +r~2Q+[m] < 1/4. (5.38) 



Proof of (15321). Assume that s E iql^^,q^^^]. Then fl538l) imphes \\Q'^^'m\\ < 
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s/2 which by Lemma \5.3\ inequahty (15.71) . has at most q rij-ATQ <s (ivq~) solutions. 
Similarly (I5.38P implies by triangle inequality that for fixed rh (in (I5.38P ) the number 
of pairs (m, m) for which (I5.38P holds is bounded by the number of elements v in the 
dual lattice A' = Q~^I'^TL^ to A such that s\v\ < 1. Since the successive minima for 
this dual lattice are determined by Lemma 15. 5[ we may use Lemma 15. 3[ (inequality 

(15. 7p ). again to determine the upper bound c'^ Hj ■ a^q >s ("7^) ^^^^ number as well. 
The product of both numbers yields the desired bound for the number of solutions of 
fl5.38p . Finally, using f l5.37p and Minkowskis Theorem 15.51 ( inequality fl5.13p for non 
unimodular lattices), i.e. Ylj -^QJ |det Ql"^''^, shows the desired bound v^q(s) in 

(I5:32|) of Lemma EH The inequahties ([533]), (ICTj) for s > g^/^ and s < are 
immediate by these arguments. 

Proof of (I5.35p . Assume q^ \t' r\ > 1 and qo > I. If m = we conclude that 
Q'oll'^lP ^ 1^' ^"1^11^+ ^'^ll^ < 1/4- Hence m = 0. For any fixed m ^ and ||Q^^^^m — 
5*771 II ^ < 1/4 the triangle inequality implies that there is at most one element 
m G Z"^ with r\\Q_^_^^'^m — t'Q^^^'^Sm\\ < 1/2. Furthermore, we get |||Q_,_"^^^m|| — 
1/(2 r) I < ||t'(5+^^^ 7Ti|| for that pair {m,m). This implies 



l/A>Ht{m,rh)>r^'^\\Ql^^^rhf> ||g+'^^m|| - 1/(2 r) /\rt 



and hence 



||g;'/'m|| -l/(2r) 



< |rt'|/2. Thus 



e At : \\vf < 1/4} <d (r^^ + |r t'l)'^ |det Ql^/^^ 

Proof of (I5.36p . Similarly, the equation (I5.38P implies by triangle inequality that 

|||g;'/'m|| - ||t'gy'5m||| < {2ry' < (2gi/2)-i. (5.39) 

Again iKm implies |tV|r-^||Qy^m|| < |t'r|l/2 < (4g^/2)-i ^gj^^g 2q^/^\t'r\ < 1. This 
leads to a contradiction unless m = 0. Hence, the possible solutions for m in (I5.39P sat- 
isfy ||Qy^m|| < 1 2 t'r I ~^ which as in the proof of f l5.32p has at most Q|det (5|~"'^^^|2t'r|~'^ 
solutions which completes the proof of fl5.36p in view of f l5.37p . 

□ 

5.2. Approximation by compact subgroups. Later on we need to average over 
powers of the a^-characteristic of 2(i-dimensional lattices A^ in Section O In order to 
use harmonic analysis tools we shall approximate the subgroup U of SL{2, M) in (I5.20p 
locally by a compact subgroup K = 5*0(2) = {k6 : 6 E [0, 27r]} with elements 

, def / cos6' sin^ \ /r Ar.\ 

kg = { . a a ] . (5.40) 
\ —smtl cos 6 1 ^ ' 
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Lemma 5.9. We have for t E [—2, 2], r > 1 and any 2d- dimensional lattice A in {M?Y 
with diagonal action of d^, Ug and kg 

aj{drUtA) <t^d aj{drkgA), j = l,...,2d, where (5-41) 
6 = arcsin(t (1 + t^)^^/^) , or, equivalently, t = tan^. 

Proof. Let m.,m eM.. Note that rh + tm = (l + t^)m + t(m — tm) , which imphes that 

{m + tmf < 2{l+t^f {mf + 2t^ {m-tmf, and 
r^{m-tmY + r~'^(m + tmY < 2 (1 + t^)^ (r^ (m - tm)^ + r~^m^) , (5.42) 

for r > 1. By definition of 6 in (I5.42p we have 

1^1 < c* = arcsin(2/V5), cosO = {1 + t^)-^/\ sin ^ = t (1 + t2)-V2_ (5 43) 

Dividing by 2 (1 + 1"^)"^, using ( 00]) and (K^ . we get with t] = {fn, m) 

WdrUtriW^ > \\dr kg r]f {1 +t^y^ /2 > \\drkev f/lO, 

for any 77 G A. Applying Lemma 15.21 to the norms Fi{ri) = \\drUtT]\\ and F2{ri) = 
WdrkgriW and using Lemma [5.31 we conclude the proof of Lemma [5.21 □ 

5.3. Irrational and Diophantine lattices. We consider Diophantine approxima- 
tions of A =^ tQ hj integral matrices using, see fl2.12p . with approximation error 

Sa;s = min|||M-mA|| : m e Z,0 < \m\ < R, M e M(d,Z)|, R > L (5.44) 

Note that by Lemma [5l8l the quantity I3t-r '= ttd(Aj)r^'^|det(5|^^^ is uniformly bounded 
(in t), that is (3t-r 1 for r > g^/^. Larger values of (3t:r enforce smaller values of the 
rational approximation error 6tQ-R. 

Lemma 5.10. Assume that go ^ 1- Then we have for all t and r > 1, writing 

tit — Pt;r 

5tQ;R, < Rtr~'d'^' (5.45) 
Note that this bound is nontrivial for Pt-r ^d ^'"^ only. 

Before proving ( I5.47p . we shall state some important consequences. 

Corollary 5.11. Consider any interval [T„, T] with T„ G (0, 1) and T > 2. 

i) If Q is irrational then 

lim sup ad{At)r~'^ = 0. (5.46) 

r-s>oo T-<t<T 

a) If Q is Diophantine of type (k, A), where 1 > k, > 0, A > 0, that is, 

JM^5tQ,fi > for all R>1, (5.47) 
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then 

sup ad{At)r-'^\detQ\-^/^ < A-^ max{T^+\T''}r-^+^\ (5. 

T-<t<T 

Proof, i) Assume that there is an e > and sequence rj, tj such that hnij rj = oo and 
/3t ;r > ^- Passing to a subsequence we may assume that hmj tj = t, t e I = [T_, T]. 
Thus (15:471) yields hm^ r|/3t^,.Rj = 0, R* = fS;:},.^ < e"\ or hm^HMj - tjmjQW = for 
some Mj G M{d,Z) and rrij G Z with \mj\ < e~^. Obviously both, ||Mj|| and \mj\ 
are bounded. Hence there exist integral elements M, m and an infinite subsequence 
j' of j with Mj/ = M, rrij' = m and by construction limj/ tj/ = t. These limit values 
satisfy \\M — mtQ\\ = 0, that is Q is rational. The last arguments are similar to 
those in |Got04) . p. 224, Lemma 3.11, which yields an alternative proof of fl5.46p when 
combined with (15. 6p . 

ii) Write Pj.^ '= ^'^Pt&i f^t;r- Since R — t- {StQ-n)^^ is nondecreasing, we obtain for 
every t e I = [T_,T] with /3t-r > r"^ using (07|i that 

A;. < r~'{6,Q,nr' < r~\6,Q,,.r' < A^^-^^'^ (5.49) 

In case that (3t-r < f'"^ this bound obviously hold. Hence we conclude (I5.48P as claimed. 

□ 

Proof, of Lemma 15.101 For fixed t we rewrite the ctrf-characteristic using the quadratic 

/ rO~^^^ \ def 

form Ht as in (I5.22p as follows. Let D.j.q = I ^ _i 1/2 1 and Utq = 

Y r Qj^ j 

/ ^ denote elements of SL(2(i, M), where t' '= ^t Write Dr for DrQ with 

Q = Id. Then Ht{l) = HDgD^f/ig/p = WdrUtTAqlW^ using the notations of flSTTj) - 

(I5.2ip . Introduce the 2 d-dimensional lattice Qt = DrUtqli^'^. The a-characteristic 
of the lattices At = drUtAq, where Aq = TAqT?'^^ may be rewritten in view of (l5.22p 
as a;d(Aj) = adiDQ^t) = \\wi A ... A Wd\\, by means of rf-vectors Wj G DqQt. Here we 

used the standard Euclidean norm on the exterior product Ed '= A'^M^'^. If go > 1 the 
minimal eigenvalue of the dth exterior power A'^Dq of Dq on Ed is given by |detQ|^^/^. 
Thus for any w E Ed we have || A'^-Dqil'|| > |detQ|~-^/^||tf;|| and we obtain 

ad{At) = adiDgnt) < \detQ\'/^ad{nt). (5.50) 

Write ad(^t) = WDrUtqli A ... A DrUtgldW"^, where Ij = (rrij^nj)'^ G Z^*^ is a basis 
of a (i-dimensional sublattice of Z^'^. Let L denote the rf-dimensional subspace of M^"^ 
generated by DrUtqlj^j = 1,. . . ,d. Introduce the d x d integer matrices Nt and Mt 
with columns ni, . . . , resp. mi, . . . , rud- We claim that 

adi^t) > r-('^-2) implies > |det(iVt)| > 0. (5.51) 

Assuming this fact for the moment, we may parametrize the subspace L as follows. Let 
W denote the linear map v -> {MN~'^v,v)'^ from M'^ to R'^'^. Then L = DrUtqWR'^. 
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The form {v,v)t = \\DrUtQWv\\^ is positive definite and defines a scalar product 
on M"', (similar to Ht in fl5.16p ). Choosing an orthonormal basis Vi, . . . ,va of M.'^ with 
respect to (-, ■) which diagonalizes {v, v)t we may write rij = Avj,j = 1, . . . , ci, for some 
element A G GL{d, M) such that det A = detNt. By definition we have 



arf(fit) ^ = \\DrUtQWniA...ADrUtQWnd\\=det(^{nj,nk)t, j,k = l,...,d^ 
= \detA\deti{vj,Vk)t, j,k = 1, . . . ,d] 



1/2 



d 



= \detNt\Y[\\DrUtQWvj\\. (5.52) 

i=i 

By assumption Rt = (3^^ < r^. Since ad{At)~^ = \detQ\~^^'^r~'^(3pj!^ , this means that 
by (I530|) that aai^t)"^ < r'^^Rt. Furthermore, by (15321) 

adi^t)'^ > \detNt\ max\\DrUtQWvj\\r-^'^-^\ (5.53) 
j 

since \\DrUtQWvj\\ > for all j. Using \\DrUtQWvj\\ > r\\{MtNf^ - tQ)vj\\ for all 
j, we conclude that 

r-'^Rt > adint)-' > \detNt\r-^''-^^d-'^'\\{MtN,-'-tQ)\\. (5.54) 

Since (detA'^t) A^j^^ is an integral matrix, f l5.53p and fl5.54p together imply 



min{||M - mtQ\\ : < |m| < Rt, m, M integral} < d^^'^Rtr' 



2 



which proves fl5.45p . 

It remains to show fl5.5ip . Assume that rank(A't) = d — k. Let accordingly rii, . . . , n^., 
say, denote k vectors which are linearly dependent of the independent vectors rik+i, ■ ■ ■ , Ud- 

def def 

Let Wj = DrUtqlj. We may rewrite /3 = \\wi A ... A Wd\\ replacing Wi, . . . ,Wk by 
linear combinations with Wk+i, . . . ,Wd such that the new first k vectors Wj are of the 
form Wj = [rrfij, 0)^, j = 1, . . . ,k, where rfij G Z''. Let Ij denote the corresponding 
vectors in Z^*^ such that Wj = DrUtqlj. Combine the column vectors = 1, . . .d into 
d X d matrices M and A" (for the first and second coordinates) as above. Express 
as a sum of squares of the ( ^) coordinates of u;i A . . . A Wd, say indexed by pairs 
of subsets J C {1, . . . ,d} and KG {d + 1, . . . , 2d} with \J\ + \K\ = d. Then 

where Mj, resp. denotes the submatrix of M with row numbers J resp. K. 

Similarly, let Mj^fc resp. Mjd-k denote the submatrix of Mj with column numbers 
1, . . . , fc, respectively A; + 1, . . . , d. Similar notations are used for the other occurring 
block matrices. Note that by the rank assumption = unless \K\ < d — k. Thus 
we may choose a subset K with \K\ = d — k such that detNK,d-k 0. Similarly 
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we may choose a subset J as well with \ J\ = k and det Mj^fc 7^ 0. Since the k x k- 
matrix Mj,fc thus obtained is invertible we may evaluate the determinant \/3j,k\ via 
Wj,k\ = |r'^(detMj,fc)r"('^-^)(detiVK,d-fc)|. Hence by (ESSD 

/3 > \(3j,k\ > r~^'~'''\detNK,d~k)idetMj,k) > r~^''-^^\ (5.56) 

which yields a contradiction to adiP-t)^^ = (3 < r'^"^, unless k = 0, thus proving the 
claim in f l5.5ip . 

Thus we may assume k = or det Nt ^ and here fl5.56p implies /3 > r'^^detA'^t. 
Furthermore, by definition /3 < r'^^Rt, which finally yields IdetA'fl < Rf, thus proving 
the remaining upper bound for jdetA'^tl in (I5.5ip . □ 

6. Averages Along Along Translates of Orbits of K 

6.1. Application of Geometry of Numbers. In order to estimate the error terms 
h,± in (14. 4p we need in view of Lemma [4. II and Lemma [4.41 and (I4.39P an estimate of 



/ 

J\t\ 



'|i|>l/r 

where denotes the smoothed indicator function of [a, 6], see (I3.18p . which is bounded 
from above by exp{— cilwil**}, \t\ > 1 with < k, < 1 and < < 1, see (14. 3p . and ijj 
denotes the theta-series of (I4.40p . We shall start with bounds of this integral over an 

interval / =^ [to — 2, to + 2], to ^ K of fixed length. 

The results obtained by geometry of numbers in Lemma 14.51 and (I5.25P in Lemma 
15.61 will be used to bound this integral. Introduce the maximum value over I of the a^- 
characteristic for the lattices = drUtAg, (using the notations in (I5.18P and (I5.19P ). 

as well as for the lattices A^^q =^ drgUtAg, where rg =^ Q^^"^, via 

-fiAr) = snp{(^r^'^ad{drUtAQ)y : t G /}. (6.1) 

Here 'Ji^i3{r) depends on the Diophantine properties of an irrational Q and tends to 
zero for growing r by Lemma 15.111 Using the notations of section 15.21 the following 
Lemma holds. 

Lemma 6.1. Let I = [to — 2, to + 2], r > tq and choose < /3 < 1/2 such that I3d > 2, 
/3 < 1/2 and let d > 5. Then we have with 'gi =^max{|^^(t)| : t G /} 



sup 



dt 



0.{t)gUt) 

adidr.keAQ^sf — , (6.2) 
27r 

where tq =^ ^ and J denotes set of points sj '= to — 2 + j ^ E I, j = 1,2, . . .. 
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Proof. Estimate [g^jl by its maximum 'gj on I and use Lemma [4.41 to bound 6y{t) by 
view of Lemma [5.51 with e = 1 together with fl5.25p for /i = cf^'^, we have 

^(r,t) < if{weAt:\\w\\^<l}<i^{weAt:\\w\\<d^/^} 

«rf d"'a,iAt)<^dr'^'-^''liAr)M^tf- (6-3) 
Similarly, estimating |^^| by its maximum ^/ on I and using Lemma l474l to bound 6^(1) 
by |detQ|-l/V'^/V(^,^)^^^ we get 



K = sup 



e,{t)gUt) dt «, ?/|detg|-i/V^-'^^,,^(r) / a^iAtf dt. (6.4) 



Using (I5.27p . we have d^Ut = drUt-s^Ug^ = dr^dsdrgUsp where s =^ (t—Sj)rQ. Changing 
variables from t to s we obtain in terms of the lattices Aq^s 

/ ad{AtYdt '^d ^ adidrgUsdrgUs^ Aq)'^ dt 

■Cd max / adidrgUsAq syds. (6.5) 

s,GJ J_2 

Finally, we estimate the last average, using Lemma 15. 9[ by the average over the group 
K. Change variables e{s) = arcsin(s/(l + s^)^/^), s G [-2,2]. Note that \e\ < c* = 

arcsin(2/-v/5) < 1.2. With ds = Vl + ^d9 we get (see f l5.42p ) by completing the 
integration over 6 from the subinterval [— c*, c*] to the arc [— vr, vr] 

adidroUsAQ^s^ds <^ J ad{drke{s)AQ^sy ds j adidrkeAq^s^^- 

This together with inequalities (16. 4p and (16. 5p completes the proof. □ 

In the following paragraphs we shall develop explicit bounds for averages over the 
group of type J^ad{drkA)/^dk. 

6.2. Operators Ag and functions tx on S'L(2,R). Let G = S'L(2,M). We consider 
two subgroups of G: 



and 



K = 50(2) = <! k{9) = ('''"'f ) ■.0<e<2n 

^ ' ' ^ ' * smb' cos 6* ' ~ 



T={(1 /_J:a>0,feG 



According to the Iwasawa decomposition, any g E G can be uniquely represented as a 
product of elements from K and T, that is 

g = k{g)t{g), k{g) e K,t{g) eT. 
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da \ (a ^i] ■ a> \ and = {da : a > 1}. 



Now let 

^ ^£ S ( 

According to the Cartan decomposition, 

G = KD+K, g = h{g)d{g)k2{g), g e G, h{g), h{g) G K, d{g) e D+. 

In this decomposition d{g) is determined by g, and if g ^ K then ^1(5') and ^2(5') are 
also determined by g. It is clear that ||5f|| = ||(i((yf)||. Since da is the conjugate of da-i 
by /c(7r/2), we have that g~^ G KgK or equivalently, d{g) = d{g~^) for any g & G. 
Therefore, ||5f|| = Hfi'^"'"!!, G G. 

We say that a function / on G is left K -invariant (resp. right K-invariant, resp. 
bi-K -invariant if f{Kg) = f{g) (resp. f{gK) = f{g), resp. f\KgK) = f{g)). Any 
bi-ii'-invariant function on G is completely determined by its restriction to D~^. Hence 
for any bi-ZC-invariant function / on G, one can find a function / on [1, 00) such that 
fi9) = f{\\9\\),9eG. 

For any A G M we define a character Xx of T by 



a b 



-A 



and the function ip\ : G ^ by 

^x{g) = xx{t{g)), g eG. 

The function ip\ has the property 

^x{kgt) = xx{t)^x{t), geG,keK,te T, (6.6) 

and it is completely determined by this property and by the condition y^x{l) = 1. 

For g & G and a continuous action of G on a topological space X, we define the 
operator Ag on the space of continuous functions on X by 

{AJ){x) = j f{gkx)da{k), x e X, (6.7) 

K 

where a denotes the normalized Haar measure on K or, using the parametrization of 
K,hj 

27r 



{AJ){x) = ^J f{gk{e)x)de, 



X e X. 



The operator Ag is a linear map into the space of i^-invariant function on X. If X = G 
and G acts on itself by left translations, then Ag commutes with right translations. 



QUADRATIC FORMS 



39 



From these two remarks, or using a direct computation, we get that Ag(p\ has the 
property fl6.6p . Hence ipx is an eigenfunction for Ag with the eigenvalue 

Txig) = (A,^a)(1) = J Vx{9k)da{k) = j xx{t{9{k))da{k). (6.8) 

K K 

We see from ( 16. 8p that t\ is obtained from ip\ by averaging over right translations by 
elements of K. But ip\ is left ii"-invariant and Ag commutes with right translations. 
Hence this function t\ is bi-i^-invariant and it is an eigenfunction for Ag with the 
eigenvalue Tx{g), that is 

AgTx = Tx{g)Tx or {AgTx){h) = Tx{g)Tx{h), h e G. (6.9) 

We have that 

^x{g) = \\ge4-\ e G, ei = (1, 0), (6.10) 
where || ■ || denotes the usual Euclidean norm on M^. Indeed 

Vx{g) = Xx{t{g)) = \\t{g)ei\\-'' = \\k{g)t{g)e4-^ = Wge^-^. 
From (16. Sp and (I6.10p we get 

Tx{g) = j \\gke,\\-Ha{k) = ^J \\gkie)e^\\~^de (6.11) 

K 

= ^y" \\g{cos e, sin 9)\\-^de = j \\gti\\~^di{u), 

Si 

where 5"^ is the unit circle in and £ denotes the normalized rotation invariant measure 
on S^. One can easily see that H^f-uH"^, & G,u & S^, is equal to the Jacobian at u of 
the diffeomorphism v ^ gv / \\v\\ oi onto S^. On the other hand, it follows from the 
change of variables formula that 

M M 

where / : M — )■ M is a diffeomorphism of a compact differentiable manifold M and Jf 
(resp. Jf-i) denotes the Jacobian of / (resp. /~^). Now using f l6.1ip we get 

rx{g) = r2-x{g-') = r2^x{g),ge G,XeR. (6.12) 

The second equality in (I6.12p is true because tx is bi-i^-invariant and g~^ G KgK. 
Since, obviously, TQ{g) = 1, it follows that 

r2{g) = To{g) = 1. (6.13) 
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Since is a strictly convex function of A for any t > 0, t 7^ 1, it follows from ( 16. lip 
that Tx{g) is a strictly convex function of A for any g E K. From this, fl6.12p and f l6.13p 
we deduce that 

Tr^{g) < Tx{g) for any g ^ K and 1 < r/ < A, 
Tr,{g) < 1 and Tx{g) > 1 for any g ^ K, < r/ < 2, A > 2, (6.14) 

and 

Triig) < rx{g) for any ^ ^ A', A > 2, < 7/ < A. (6.15) 

Since the function Tx{g) is bi-K-invariant, it depends only on the norm ||5f|| of g. We 
can write 

rxig) = rxm\), 9^G, (6.16) 

where 

fx{a) Txida) = [ \\dakeit'da{k) (6.17) 
Jk 

1 r de 

a > 1. 



27ry (a2cos2^ + a-2sini^)A/2 



It follows from (16. 9 p and the definition of Ag that 



fx{\\gkda\\)d<j{k) = Tx{g)fx{a). g(^G,a>l. (6.18) 



K 

Since \\g\\ = \\g^^\\ for all g E G, 

a 

\\9\\ 

for aW k E K and g E G. From this, (I6.14p and ( I6.18P we deduce that, for any A > 2, 
the continuous function fx{a),a > 1, does not have a local maximum. Hence fx is 
strictly increasing for all A > 2 or, equivalently, 

rx{g)<Tx{h) if ll^ll < A>2. (6.19) 

It follows from f l632ll and (Km that 

27r 

fx{a) = r2-x{a) = — [ {a^ cos^ 6 + a"^ sin^ e)^~^d9. (6.20) 

27T J 



Since a^cos^6' < a^cos^6' + a^^ sin^ 6* < a^, we deduce from fl6.20p the following esti- 
mates 

c(A)a^^2 < fxia) < a^~^ a > 1, A > 2, (6.21) 
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where 



2lT 



Zn 



cos I 



\A-2 



(2A - 3) 



It also follows from (I6.20p that, for any A > 2, the ratio is a strictly decreasing 
function of a > 1 and 



lim 



Txia 



A-2 



c(A). 



Lemma 6.2. Let g e G, g ^ K, X > 2,0 < rj < \,b > 0,Q > 1, and let f be a left 
K -invariant positive continuous function on G. Assume that 



Agf < Tx{g)f + brr, 

and that 

f{yh)<Qf{h) if HeG^yeG and\\y\\<\\g\ 
Then for all h E G, 

(A,/)(l)= / f{hk)da{k)<sT^{h), 



(6.22) 
(6.23) 



where 



Proof. Let 



Q 



K 



/(I) 



(6.24) 



fK{h) 



def 



f{hk)da{k), heG. 



K 



Since Ag commutes with right translations, and Trj is right i^'-invariant, it follows from 
that AgfK < Tx{g)fK + If ^ and y are as in then f{yhk) < Qf{hk) 

for every k E K and therefore fxiyh) < QfK{h). On the other hand, it is clear that 

fK{h) = {A,fK){l) = {A,f){l). 

Thus we can replace / by /x and assume that / is bi-J^"- invariant. Then we have to 
prove that / < stx. Assume the contrary. Then f{h) > s'Tx{h) for some h E G and 
s' > s. In view of fl67[5l) and ( Km . s' > s > (5/(1). From this, flCTl) and IK^ we 

get that \\h\\ > \\g\\ and 



fiyh) > Txiyh) if ||y|| < \\g\\ and \\yh\\ < \\h\\. 



(6.25) 
□ 
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Using the Cartan decomposition, we see that any x E G with g}| < < \\h\\ 

can be written as x = kiyhk2 where ki,k2 G K, \\y\\ < \\g\\ and \\yh\\ < \\h\\. But the 
functions / and ta are bi-ii'-invariant. Therefore we can get from ( I6.25P that 

fix) > ^ rx{x) if PI < \\x\\ < \\h\\. (6.26) 
Q \\9\\ 

Let 

def b def s' b 

rx{g) - Trjig) Q Tx{g) - r^(^) 

= f - axTx + a^r^. 

Then, in view of ([S3]) and fl02|l . 

^gt^ - T-A(fi')w = Ag(/ - OaTa + ariTri) - Txig){f - axTx + fl^T^) (6.27) 
= [M9)f - Txig)!] - ax[AgTx - Tx{g)Tx] + [AgT^ - Tx{g)Tr,] 
< bTr, + ttr, [Tn{g)Trj - Txig)^] = 0. 

Since ta(1) = t^(1) = 1, we have 

Lo{l) = f{l)-ax + a,<0. (6.28) 
It follows from ( l05l) that > 0. From this, (K2M and flOHl) we get that 

u{x) = f{x) - axTx{x) + a^r^(x) > f{x) - axTx{x) (6.29) 

> (^-aA)rA(a;) = Oif ^ < < 

Let V G G, < \\h\\, be a point where the continuous function u attains its 
minimum on the set {x E G : \\x\\ < \\h\\}. It follows from ( I6.28p and ( I6.29p that 

u[v) < and \\v\\ < 



\9\\ 

Then, since Tx{g) > 1 and < || for all k E K, 

{AgUj){v) = j uj{gkv)da{k) > uj{v) > rx{g)uj{v). 

K 

We get a contradiction with ( 16.27^ . 

As a special case {t] = 2 and 6 = 0) of Lemma [6. 2[ we have the following 

Lemma 6.3. Let gEG,g^K,X>2,Q> 1, and let f be a left K-invariant positive 
continuous function on G satisfying the inequality / 1 6'. 2'^) . Assume that 

Agf < rx{g)f. 
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Then for all h E G, 

= I f{hk)da{k) < Qfil)Txih). 



K 

Lemma 6.4. Let g e G, g ^ K,2 < X < j2,Q > 1, M > l,n e N+, and let fi, < i < 
n, he left K-invariant positive continuous functions on G. We denote min{z,n — i} by 
i and ^ fi by f . Assume that 

0<i<n 

fiiyh) < Qfiih) ifO<i<n,heG,yeG and \\y\\ < \\g\\, 



Agfi < Tx{g)fi + M max ^/fi-jfi+j, < t < n, (6.30) 

0<j<i 

in particular, 

Agfo < rxig)fo and Agf^ < Tx{g)fn- 
Then there is a constant B = B{g, A, fi, Q, M, n) such that for all h E G, 



= J f{hk)da{k) < Bf{l)T,{h). (6.31) 

K 

Proof. For any < e < 1 and < z < n we define 



def 



fi,e = s'^^'^fi where q{i) = i(n-i] 
It follows from ( I6.30p that for alH, < i < n, 

A,/,, = £'^(%/,<£''«rA((7)/. 



+£^(*)M max Je-i('-^)fi^j.se~i(^+i)fi+j.s 

0<j<i V 



= Tx{g)f^.s + M max / 

0<j<i ^ 

Direct computation shows that 



<l{i) - - j) + + j)] =f- 



Hence for all i, < ? < n, 



Agfi,e < rx{g)fi,e + eM max_ ^/J~~J~^^. (6.32) 

0<j<i 

Let ffr =^ ^ /j^e. Summing f l6.32p over alH, < i < n, and using the inequalities 

0<i<n 

fe > \J fi-3,e, fi+j,e, I < i < U - 1, < j < i, we get 

Agf, = ^9ke < rx{g)fe + eM{n - 1)/, (6.33) 

0<i<n 

= [Txig)+eM{n-l)]f,. 
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Let 

M(n-1 /• 

Then it follows from fl6.33p that 

Now we apply Lemma 16.31 to /^g and get that for all h E G, 

< ^o"'(A/.o)(l)<^o"V.o(l)r.W 

< e^-'Qf{l)r,{h). 

Hence flOT]) is true with B = Eq^'^Q. □ 

Proposition 6.5. LetgeG,g^K,deN'^,Q>l,M>l. For every <i <2d, let 
Aj > 2 and let fi be a left K -invariant positive continuous function on G. We denote 
m.m{i,2d — i} by i and ^ fi by f . Assume that 

0<i<2d 

> for any i ^ d. 
f^{yh)<Qfi{h) if{]<i<2d,heG,yeG and\\y\\<\\gl (6.34) 



Agfi < Tx^ {g)f^ + M max ^/f~f^j, 0<t<2d, (6.35) 

0<j<i 

in particular, 

Agfo < Txoig)fo and Agfid < Tx,^{,g)f2d- 
Then, using the notation <^ (which until the end of the proof of this proposition means 
that the left hand side is bounded from above by the right hand side multiplied by a 
constant which depends on g,XQ, . . . , X2d, Q and M, and does not depend on /q, . . . , f2d), 
we have that 

(a) For all h & G and < i < 2d, i ^ d, 



(A/,)(l) = J f.{hk)da{k) « /(l)r,(/i), 

where 

ri = Xd- 3^^'^+^) {Xd - v') < Ad and ri' = max{Ai : < i < 2d,i d}. (6.36) 

(b) For all heG, 

(A/,)(l) = J fdihk)da{k) « f{l)Tx,{h). 

K 

(c) For all heG, 

(A,/)(l)= / /(/.A;)da(A;) «/(!)" ^"^-2 



K 
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Proof, (a) Let 

hAh) = j Mhk)da{k),heG. 

K 

It follows from the Cauchy-Schwartz inequality that 

\l fi^j{hk)fi+j{hk) da{k) 



< J / f,^jihk)a{k) J / U+^{hk)da{k) 



Hence 



= \J fi-j,K{h)fi+j,K{h). 
/ max J fi^j{hk)fi+j{hk) da{k) 

J 0<j<i V 



0<j<i 



- \ fi-j,K{h)fi+j.K{h) < dmax J fi_j^K{h)fi+j,K{h). 

0<i<i 

On the other hand, 

{AJ.^ih) = j {AJi){hk)da{k) 

K 

and, according to (I6.35p . 

{AJi){hk) < r^X9)f\{hk) + M max J f,_,{hk)f,+,{hk). 

0<j<i V 

Therefore 



Agfi,K < TxX9)fi,K + dM max y^f~~f~^j. 

0<j<i 

But 

= {Ahfi,K){i) = (Ahmi) 

and, as easily follows from f l6.34p . 

fi,Kiyh) < Qfi,K{yh) 

ii h E G,y E G and ||?/|| < \\g\\. Thus, replacing fi by fi^x and M by rfM, we can 
assume that the functions fi are bi-i^-invariant. Then we have to prove that 

/i < /(l)r^ for all < z < 2rf, z 7^ d. (6.37) 

□ 
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Let, as in (I6.36p . r( = maxjAj : < i < 2d, i 7^ d}. We define fj,i,0 < i < 2d, by 

Aid = Ad + 3-(''+i)(Ad-V) and (6.38) 

/i* = /id - S-\Xd -7]'),Q<i<2d, i^d. (6.39) 
Since, in view of (I6.15p . T\^{g) < r^^{g), it follows from fl6.15p and Lemma [63] that 

h < /(l)r^„ 0<t<2d. (6.40) 

One can easily check that 77 > /i^ > Aj > 2 and therefore > r^- for all < ? < 
2d, i ^ d. Thus, to prove fl6.37p . it is enough to show that 

/, < /(I) V, for al\0<i<2d,i^ d. (6.41) 

We will prove (I6.4ip foT i < d — 1 using induction in i; the proof in the case i > d+1 is 
similar. In view of fl6.15p . T^^{g) > Tx^lg). Then for i = it is enough to use Lemma 
16.31 Let 1 < m < d — 1 and assume that ( I6.4ip is proved for all i < m Then, in view 
of flCTj) . for < j < m, 

< < /(l)l'(M™-i+Md)/2- 

(The second inequality in (16.420 follows from ( I6.15P and fl6.39p . and the third one 
follows from fl636|) and ( K2T\f .) 

Combining (I6.35P and ( I6.37P we get 

Agfm < T-Xm{9)fm + C'/(l)^(/.„_i+A.d)/2, 

where 

C< 1. 

On the other hand, as follows from ( I6.38P and ( I6.39p . Am < /U-m and (/im-i+/id)/2 < fim- 
Now, to prove that ^ /(l)'i7i ? it remains to apply Lemma 16.21 (and use again 

(b) As in the proof of (a), we can assume that the functions /j are bi-i^-invariant . 
Then we get from fl6.35p and (I6.37P that 

Aj,<nJd + Df{i)T„ 

where D ^ 1. But rj < A^. Therefore, Lemma [6.21 implies that fd ^ /(l)rA^ which 
proves (b). 

(c) Follows from (a), (b), ([615]) . (KW) and ([QT]) . 
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6.3. Quasinorms and representations of SL(2, M). We say that a continuous func- 
tion V ^ \v\ on a real topological vector space V is a quasinorm if it has the properties: 

(i) |f I > and \v\ = if and only if = 0; 

(ii) |Af| = \\\\v\ for all A G M and v ^V. 

If V is finite dimensional, then any two quasinorms on V are equivalent in the sense 
that their ratio lies between two positive constants. 

Lemma 6.6. Let p he a (continuous) representation of G = SL{2,M.) in a real topo- 
logical vector space V , let \ ■ \ be a K-invariant quasinorm on V, and let v &V,v ^ 0, 
be an eigenvector for T corresponding to the character X-r,^ ^ IR; that is 

a b 



Then for any g E G and (5 G 



and 



\p{g)v\-^ = ^p,{g)\v\-^ (6.43) 
da{k) 



K 



\p{gk)v\ 



Tpr{g)l\vr (6.44) 



Proof. Using the K-invariance of | ■ | we get that 
\p{g)v\"P = \pikig))pitig))v\-^ 

= mg))vr' 

= \x-Mg))v\-'' = x^Mg))\v\~'' = ^^r{g)\v\-^. 
The equality (I6.44p follows from (I6.43P and from the definition of T/^rig)- D 

Let ll^ll denote the norm of 2; G corresponding to the standard Hermitian inner 
product on C^, that is 

where z = x-\-iy,x,yEM.^. 
Lemma 6.7. For any z G C^, z ^ 0, g E G and (3 > 0, 



/3 
K 



da{k) 



\\9kz\\ 



Proof. Since the measure cr on is translation invariant, 

F{kz) = F{z) for any k E K. (6.45) 
Also, for all A G C, A 7^ 0, and zeC'^,z^O, 

F{Xz) = F{z) (6.46) 
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because \\Xv\\ = \X\\\v\\,v e C^, and because G = SL(2,M.) acts linearly on C^. Any 
nonzero vector x G can be represented as x = Xkei, X &M.,k E K,ei = (1, 0). Then, 
using (16. lip from section 16. 2[ we get from fl6.45p and f l6.46p that 

F{x) = F{ei) = Tp{g) for all x G M^ x ^ 0. (6.47) 

Let now z = x + iy,x,y E M^, 2 7^ 0. We write = xe + iye, xe, ye ^ IR^- Then jj^- 
is a continuous function of 9 with values in M U {00}. But e^^'^z = iz = —y + ix anc. 

therefore jj^'^^^jj = ^jj^j • Hence there exists 9 such that \\xe\\ = \\ye\\- Replacing 

then z by e^^z and using f l6.46p we can assume that ||xe|| = \\ye\\- Now using the 
convexity of the function t t > 0, and the equality (16.471) we get that 



da{k) 



da{k) 



\\gkz\\P J (||^A;x||2+ ||^%||2)/3/2 

K K 



Clearly (ICT]) implies (ICTj) . 



da{k) 

JgkW 
Ma) ^ MaY 

1 

1/3 . 2-/5/2 



da{k) 




\\gky¥ 




= 2^^/V,(,) 






WzP' 





X 



□ 



Let Vn denote the (m + l)-dimensional space of real homogeneous polynomials in two 
variables of degree m, and let ipm denote the regular representation of G = SL{2, M) 
in Vm ■ {ipm{g)P){x) = P{g^^x),g e G,x e "^^^P E Vm- It is well known that, the 
representation is irreducible for any m and that any irreducible finite dimensional 
representation of G is isomorphic to ipm for some m. Recall that all finite dimensional 
representations p of G are fully reducible, i.e. p can be decomposed into the direct sum 
of irreducible representations. We define 

J(p) = {m G N"*" : iprn is isomorphic to a subrepresentation of p}. 



Proposition 6.8. Let p he a representation of G = SL{2, 
space W . Then there exists a K -invariant quasinorm \ ■ \ - 
any w eW^w ^ g E G and /3 > 0, 

daik) 1 
I / , X |g < max {r^„(^)} — 

\p{gK)w\P m£l{p) \w\' 



in a finite dimensional 
■ \p on W such that for 



K 
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n 

Proof. Let W = he the decomposition of W into the direct sum of p{G) - 

1=1 

irreducible subspaces, and let iTi : W ^ Wi denote the natural projection. Suppose 
that we constructed for each i a /T-invariant quasinorm | ■ |j = | ■ |p. on PVj such that 
for any w G Wi, w ^ 0, g ^ G, and /3 > 0, 



K 



I fff I, <^/3r.w(^)^, (6.48) 
\pi{gk}w\P ^ \w\^ 



where pi denotes the restriction of p to Wi and m(z) G I{p) is defined by the condition 
that iprn(i) is isomorphic to pj. Then we define \w\ = \w\p by 

\w\ = max \7ii{w)\i, w E W. (6.49) 

l<i<n 

Clearly | ■ |p is a i^-invariant quasinorm. Let us fix now w E W,w ^ 0, and choose i 
such that \w\ = \TTi{w)\i. Then 

da{k) ^ f da{k) 



\pigk)w\^ - J \7r,{p{gk)w)\^ 

da{k) 



K K 



I 

K 



Pi{gk)Tx,{w)\- \T^i{w)\i 



T-/3m(i)(^)^ < max {r^„,(^)} 



Thus it is enough to prove the proposition for representations D 

Let P G Vrn,P 7^ 0. We consider P as a polynomial on and decompose P into 
the product of m linear forms 

P = il ■ . . . ■ £m, (ii{Zl, Z2) = ttiZi + biZ2, tti, biZi, Z2 G C. 

There is a natural i^-invariant norm on the space of linear forms on C^: 

\\if = \a\' + \b\\ i{zuZ2) = az, + bz2. 
Now we define a quasinorm on Vm by the equality 

\P\ = \\il\\-...-\\em\\. (6.50) 

This definition is correct because the factorization fl6.50p is unique up to the order of 
factors and the multiplication of £j, 1 < 2 < n, by constants. We denote by ipi the 
extension of ipi to the space of linear forms on G. It is isomorphic to the standard rep- 
resentation of G on . Then using Lemma 16.71 and the generalized Holder inequality, 
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we get that 



l/m 

da{k) f da{k) I f da{k) 



K 




i=l 



i=l 



Since I{ipm) = {fn}, flO.Sip implies ( I6.48P for p = ifjm- 

We remember (see (I6.14p and (I6.15P from section I6l2] that T^{g) < 1 and T,j{g) < T\{g) 
for any g^K,0<p<2,X>2 and < ?7 < A. Using this, we deduce from Proposition 
16.81 the following corollary. 

Corollary 6.9. Let p be a representation of G = SL{2, M) in a finite dimensional 
space W , and let m be the largest number in I{p). Then there exists a K -invariant 
quasinorm \-\ = \-\pOnW such that 

(i) if /3 > and [5m > 2 then for any w G W , w ^ 0, and g E G, 

da{k) . , 1 



< Tpmig) 



\p{gk)w\l^ \w\^^ 



K 



(a) if f3 > and I3m < 2 then for any w E W,w ^ 0, and g E G, g ^ K , 

da{k) ^ 1 



K 



\p{gk)w\l^ \w\f^ 



6.4. Functions at on the space of lattices and estimates for AhOi. For a lattice 
A in i?" recall the notations d{L) and ai{L) in section [5] for arithmetic subspaces of i?" 
which satisfy the basic inequalities (15.11) of Lemma 15.11 for two A-rational subspaces L 
and M. Choosing quasinorms \\-\\i on A'M" we consider the functions ai{L) and a{L), 
see ( 15. 2p and ( 15. 3p . on the space of lattices. 

Let p be a representation of G = SL(2,M.) in M", and let A*p, 1 < i < n, denote the 
z-th exterior product of p. We assume that the quasinorms | ■ |j are /^-invariant or, 
more precisely, (A'p)(-^)-iiivariant. 
We fix g e G,g ^ K. Since 

= snp{\{A' p){h)v\i ■.heA,ve A*M", \v\i = 1} 

is finite for every i,l < i < n, and every compact subset A <Z G, one can find Q > 1 
such that for any i,l < i < n, and v G A*]R", v ^ 0, 
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Q^i ^li^lPliMl^Q iiyeG^nd\\y\\<\\gl (6.52) 

where, as in section \62[ \\h\\ = ||/?.~^|| denotes the norm of the hnear transformation 
h E G = 5'L(2,M) with respect to the standard Euchdean norm on M^. From fl6.52p 
and the definition of di^{L) we get that, for any lattice A in M" and any A-rational 
subspace L, 

g-i ^ dy^{yL) ^ ^ ifyeGand ||y|| < (6.53) 

Hence for any z, < i < n, 

ai(yA) < Q«i(A) if ?/ G G and < (6.54) 
Let /3 > 0. We define functions F^,^, 1 < z < ra, on A*M" - {0} by 

/\w\ ■ 

K 

It is clear that the functions Fi are continuous and that Fi^f^{Xw) = Fi^p{w), A G M, A 7^ 



def 



0. Let Co,/3 = 1 and 

def 

sup{Fi,^(w) : w G A'M", 1^1^ = 1}, 1 < i < n. 



Hpf 

d^p = sn^{Fi^p{w):weA'W,w^Q} (6.55) 



We note that Cn.p = 1. 

Lemma 6.10. For any i,0 < i < n, 

Aga^ < c,,pa^ + C^Q^ max (6-56) 

where i = min{z, n — i}, the constant C > 1 is from Lemma \5. 1\ and the operator Ag 
is defined by (16. 7p from 1 6. ^ 

Proof. Let A be a lattice in M". We have to prove that 

j ai{gkAfda{k) < Ci^(sa,{Af (6.57) 

K 



+ C^QP max J a,.j{AYa,+j{Ay 

0<j<i V 

There exists a A-rational subspace L of dimension i such that 

5^ = "''^'' <«'^* 
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Let us denote the set of A-rational subspaces M of dimension i with d/\{M) < Q^d^iL) 
by \I>i. We get from flH755|) that 

dgkAigkM) > dgkAigkL) 

for a A-rational i-dimensional subspace M ^'^i. It follows from this and the definitions 
of ttj and Ci^p that 

j ai{gkAfda{k) < c,,pa,{Af if = {L}. (6.59) 

K 

Assume now that *i ^ {L}. Let M ^-^^M ^ L. Then dim(M + L) = i+j, < j < I 
Now by fl6.53p . f l6.58p and Lemma [5. for any k E K, 

a,{gkA) < Qa,{A) = < ^ 



< 



dAiL) ,/djL)djM) 
CQ 



^d^{LnM)d^{L + M) 



< CQ^Ja^.j{A)ai+j{A). 
Hence, if ^ {L}, 

I ai{gkAfda{k) < C^Q^ max J a-j{Afai+j{Ay . (6.60) 

J 0<j<i ^ 



K 



Combining fl639D and f l630D . we get fl637D . □ 

Theorem 6.11. Let d G N"*", and let pd denote the direct sum of d copies of the 
standard 2- dimensional representation of G = SL{2,M.). Let 13 be a positive number 
such that pd > 2. Then there is a constant R, depending only on (i and the choice of 
the K-invariant quasinorms \ ■ |j involved in the definition of ai, such that for h E G 
and a lattice A in M^'^ 

{Aha^){A) = [ a{hkAfda{k) < Ra{Af\\hf''-^. 



K 

Proof. As in section 16. 3[ for a finite dimensional representation p of G, we define 

I{p) = {m G N'^ : tpm is isomorphic to a subrepresentation of p}, 

where denotes the regular representation of G in the space of real homogeneous 
polynomials of degree m. Let rrii be the largest number in /(A*prf), 1 < i < 2d. It is 
well known that 

— nii = i =^ min{i , 2d — i} . (6.61) 
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We G.X g & G,g ^ K. It follows from ( I6.6ip and from the Corollary of Proposition 16.81 
that we can choose quasi-norms | • |i on A*M^'' in such a way that for w G A^M^'^, 7^ 0, 



J \{^^pd){g)w\'^ 



K 



and 



K 



< 1 if /3z < 2. 



Hence 



Ci,p < rpi{g) if /31 > 2, and (6.62) 

Ci^^ < 1 if /3z < 2, (6.63) 

where Cj_^, 1 < i < 2(i, is defined by f l6.55p and Co,/3 = 1. As a remark, we notice that 
Ci,p = Tfl{g)ii(3i>2). ' □ 

According to Lemma [6.101 the functions «f , < i < 2d, satisfy the following system 
of inequalities 



Let 



Agtti < Ci^i^ai + C^Q^ max_ J a^_,ai^y (6.64) 



Ai =^ max{2,/3i}, < i < 2rf. (6.65) 



Since T2{g) = 1 (see fl6.13p from section |6^ . it follows from fl6.62p - fl6.65p that 



Aga^ < TA, (^)af + C^Q^ max J a^^a^^^^, 0<i<2d. (6.66) 

0<j<i ^ 

Now we fix a lattice A in M^'^ and define functions fi, < i < 2d, on G by 

/,(/i) = a,{hAf, heG. 
Then it follows from f l6.66p that 

Agfi < ta, {g)f. + C'^g'^ max_ ^/f~f~^j, < t < 2d. 

0<j<i 

On the other hand, in view of fl6.54p . 

fi{yh) < Q^fi{h) iiQ<i<2d,heG,y eG a.nd \\y\\ < \\g\\. 
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Since Pd > 2, we have that I3d — 2 = Xd > Xi for any i ^ d. Now we can apply 
Proposition 16.81 (c) and get that 



0<i<2d 0<i<2d 

0<i<2d 

= ( E a,iAf)\\ht^-' < 2da{Af\\hf''-'. (6.67) 



0<i<2d 

The inequahty (16.671) proves the theorem for our specific choice of the quasinorms | ■ |i. 
Now it remains to notice that any two quasinorms on A^'M" are equivalent. 

7. Conclusion of the Proofs 
We shall apply Theorem 16.111 combined with Lemma 16.11 as follows. 

Corollary 7.1. Let \to\ > 2, r > rg, I = [to -2,to + 2] and /3d > 2 and 

Tji =^ max{|^^(t)| : t G /}. With the notations of Lemma \6.1\ we have 

sup / e„{t)g^{t) dt <d gjCQ-fi^p{r)r'^-\ (7.1) 
veRd- J I 

whereCQ = rl\detQ\-^/^~''/\ 

Proof. Note that ad{A) < a{A) holds for any lattice A. Since drUtAqs = drgUsAq, 
(compare (16. ip ). is self-dual, (I5.26P applies and we obtain a{drUtAQ^s) x^^ adidrUtAg^s). 
Now choosing h = drg, = r/rg, rg = g^/^ and the lattices A = Ag^g. defined in in 
Theorem 16.111 we arrive at the bound 

max r ad{dr,ke Ag,,y^ «, a{Ag^,y\\dr,f'-' «, r^'-^ (rj |det gr^/^ 

using Unroll = ''^0 and by (I5.34p . 

a(AQ,,) <d ad{Ag^s) <d IdetQr^/VJ. (7.2) 

In view of Lemma [6.11 this concludes the proof of (17. ip . □ 

In the intervals {r~^ < |t| < 1} the integrand ^^,{t),w < 1 in (16. 2p is bounded from 
above by, (see (14. 3p ). 

|^^(t)| <min{|6-a|,l/|t|} (7.3) 

and thus is of size 6 — a for \t\ < 1/(6 — a). It changes rapidly if |6 — a| > 1 grows 
with r. In order to adapt the averaging result. Lemma [TTTI to this case we need the 
following Lemma. 
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Lemma 7.2. Recall tq = g^/^. For r > tq, b — a > tq, (5d > 2 and < < 1 



we 



have with / =^ [1/r, 1 / rq] 

h{v) = J ^ \e,{t)gUt)\ dt « CQ7/,/3(r)r^-^ (7.4) 
with Cq as defined in Corollary \7.1\ . 

Proof. If |6 — a| > r^^, using (17. 4p and Lemma f l4.4p we have with d (3 > 2, Ag as 
defined in fICT]) and ([S3D with to = 

h{v) «d7/,/3(r)r(i/2-^)^|detgri/V, (7.5) 

where 

J = J ^ iMdrUtAQ))^\gn.it)\dt<Y,Ij, (7-6) 



3=30 



with 



Ij = / oid{drUt KqY \gw{t)\ dt, j = jo, jo + I, ■ ■ ■ , p= \r'] + 1. (7.7) 

J 3-^ 



and jo = Itq] . 

Changing variables via t = vj~'^ and v = s + j in Ij and using the group properties 
of dr and Ut, we have with |^tu(t)| <^ Itl^"*^ for |t| < Tq^ and Ij < I* 

I* = j ^ {a,{drUtAQ)r^ 



= / {ad{drU^j-2 Aq))'^ — 

r3+-i ^y 
< / {ad{drUyj-2 Aq)^ — 
J j ^ 



' ds 

{ad{drUsj^2Uj-i Aq)Y —— . (7.8) 

S + J 

By (IE27D, 

dy Uj gj ~ 2 — — 1 Uj -~ 2 — dy> — 1 w g d j • ^7.9^ 
According to (^M> and (17^ . 

1 /"^ 

/; < - / (ad(rf,j-iMtAj))'^ dt, (7.10) 
3 Jo 

where Aj =^ djUj-iAq. By Lemma [5. 6^ fl5.34p we have for j > jo and 

«,(A,)«, Idetgr^/VJ. (7.11) 
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By Lemma [5.91 (with to = 0), f l6.2p . we have 

ad{drj~iUtAj) <rf ad{drj-ikeAj), (7.12) 

for |t| < 1, T > 1, where kg is defined in fl6.2p . Recall that ad(A) < a;(A) for any 
2(i-dimensional lattice A. Choosing r = j and t = note that At = Aj and ( I5.26P 
yields 

ad{A,) X, a{Aj). (7.13) 
Thus Theorem 16. m with A = Aj and r replaced by rj^^, together with (17. 13p yields 

f.27r 

(«d(rf,,-i keA,)Yde \\dr,-if''-^aiA,f || f ^-^^^(A,)^ (7.14) 



Using flCTj) . (I7I2]) and (EH]) we have 



(ad(4.j-mtAj)) dt <d / {ad{drj-i kg Aj)) 



cos^ 6* 

^ / (ad(c?rj-i Aj)) d6 
Jo 

«d (7.15) 
if d > 5, f3 > 2/d. It is clear that = f^j^^- Therefore, according to ( I7.10p and 

I* «. j{rrr'~' MA,)f «, j{rr'r"'\^^tQt^'\^Q\ (7.16) 
By 0, fTTTT]) and fTTTB]) . we obtain, for d > 5, /3 > 2/d, < 1, 

J «d -{rry-^ |detQ|-^/V^" «, r^'^-Vetgr^/VJ . (7.17) 
i=io 

Collecting the bounds f l7.5p - fl7.6p and f l7.17p . we get the bound for Ii{v). □ 

7.1. Proof of Theorem 12.11 We now collect all error bounds to prove Theorem 12.11 
using the constants Cq and rq = g^/^ introduced in Corollary 17.11 

Estimate of h = Ji,± in 1^ and (OTD . 

With Ko =^ [r"\ 1] and Kj =^ [j,j + 1], j > 1, we have 

oo 

/i </i,o + $^/i,i, (7.18) 

where 



Ji =^ I dv I dt 



O.m^it) , J >0. (7.19) 



Write 

= ymin(rQ,& -a). (7.20) 
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Estimate of Ii q. Using f l4.38p we consider tlie case b — a < 1 first. Here we use 
Corollary 17. II to bound the integral over Kq using '^b — a = {b — a)*. For the case 
b — a > 1 we use Lemma [7.21 for t G Kq, \t\ < Tq^ and Corollary 17. II for the other t in 
Kq together with ^^[^-1 ij ^ {b — a)* . The result is 

/i,o «d {b-ayCQ{\oge~y^K,A^)r'~^. (7.21) 

Estimate of Ji j, j > 1. 

Using Corollary 17. II we get 

/i,, «d QK, {loge-^YCQ^K.A'rV-^ (7.22) 

Choice of parameters: 

For fixed r > q and \a\ + \b\ < cqt^, < 6 — a < cq we may choose < (6 — a)/4 
and prescribe limits for T > 2 and 1 > T_ > 1/r: 

r-^(logr)2 < < (6 - a)74, T :^dW~^h{T_), (7.23) 

def / \ ^ 

where Cq is defined in Lemma [3.31 and h{T^) = c~^( log(T_ g"^/^)'' (6 — a)* ] . 
Recall that 

\9wit)\ < mm{\b - a\, exp{-c|tM;|^/^}. (7.24) 
Thus for the choices of T and w in (I7.23P we have for sufficiently small w, 

oo 

Y,9K,<^(iw{-c\Tw\'/'}. (7.25) 

/ N 1/2-/3 

Using Corollary [7!T] and Lemma [5l8l ( I5.34p . we conclude with cn = ( |det QI^^^^Tq j , 
'^jyj'hj {\oge~^Yr'^~'^CQCQ exp{— c|Tu;|^/^}. Furthermore, ioi b — a > tq and 
j > 1 we have \gKj\ ^ j^^ exp{— c|jtf;|^/^} whereas for b — a < tq and 1 < j < 
we obtain 1^^-^ | ^ min{6 — a,j^^} . Thus with (6 — a)* defined in (I7.20p we get 

X:&,«logi^^. (7.26) 

Hence, in view of fl7.18p . f l7.19p . f l7.2ip and fl7.22p we obtain (using the notation in 

(EU)) 



h «<i (logT-i)''r--^Cg(^((,-a)-7i.„,j(r)+7|i,Tl,s(r)log^^ (7,27) 

Split Kq = Kqq U Kqu where i^oo =^ [r~\ T_] and i^oi = (T_, 1]. Then iKm yields 

7i.„o,/3(r) «. {\detQ\'/'T'_f'^' « |det Q| ^^d/^-^). (7.28) 
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Write cq =^ |det Ql^^^"^/^ > 1 and note that '-)Koi,p{'r') l[T^,T],p{f) 
Thus, we finally get 

h «d {\oge~^Yr''~^CQ(xu,,b-al[T^,T].Ar) + {h-arcQTl + 

+CQe^v{-c{Twf'^]). (7.29) 



Together with the inequalities (13. 3p and (I4.33p . (I4.35p . (I4.38P we conclude, for T > 

w;-i/i(T„), 

\^oh H ir) -Mo\H{r)\ (7.30) 
«, {\oge-y T'-'CQ{h - a)* (log ^^^7[T_,T],/.(r) + cqTI + cq exp{-c(TuO^/n 
+ {{h -a)e + w) |det gr^/V'^-^ + (log5-^)Vet gr'^V^/^ (i + |6 _ ajr-^). 

Since by ([3l]), vol if (r) >d (6 - a)\detQ\-^'^r'^-'^ and since cq exp{— c(Tty)^/^} < 
CQT^{b — a)* for T chosen in (I7.23p . we conclude for the relative lattice point deficiency 
in Theorem 12. 

A,S|^-l| (7.31) 
«« £+-j^+(log£-')''(|detQ|'/2Cg^«i=^ + r-'V2{(r,6-a)), 

where 



,6— a,u) 



W = {7[T.,T],,(r)log^^ +(6-a)*CQT^}, 



9 , b- a 
log(H ) 

e(r,6-a) " , (7.32) 

and inf^ j. denotes the infimum over all T_ G [r~^, 1] and T > h[TJ)/w. 
Fixed parameters e and w: 

When < 6 — a < rg, we may rewrite (17.310 and (I7.32p as follows: 

A, + (log£-i)'^(|detg|i/2CQpQ,,_,,^(r) + r"'^/2+i), (7.33) 

where 

PQ,-aAr) = -^^^{ ^^^__^j^^(,) + cqT1 : T„G[r-M],r>Mr_)/^}. 

(7.34) 

When r > b — a > vq we get a similar bound 

A. «. ^ + ^ + (log.-)^CQ|detg|V2 + (7.35) 
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with 

PQ,^(r) "=^'inf |(logw;-i)7[T_,T],/3(r)+CQrQTl : T_ G [r-\ 1], T », /i(T_)/ti;} (7.36) 
whereas for Cqt"^ > b — a > r we get for < < 1 in view of fl7.23p 

A. «, e + (loge-i)'^(CQ |det Ql^^ + r""^/^-^ log(r)). (7.37) 

Variable parameters e and ty: 

Finally, we may choose w = T^{b — a)* and e = subject to the restrictions in (17.231) . 
Using |detQ| > 1 this results in the following bound: 

A,. «, |det Q\'/'Cq '""^It''^ + r-n(r, & - a), 
with h{T^)TZ'^ and 

PQ,,_,(r)"=^^nf{|logT_|^(7[T_,T+],/3(r)log-^^^+CQ(6-a)*T^) : T_ G [r^Vr-i/M] }, 

(7.38) 

where ,^(r, b — a) '^riib — a<r and ^{r,b — a) <^ r'^{b — a)~^ log(r) if 6 — a > r. Since 
7[T_,T+], /?('") — )■ for r — 7- oo (and any fixed T„) when Q is irrational, we conclude that 
P*q{t, b — a,w) ^ for r — )■ oo, which proves Theorem 12.11 

Proof of Corollary [XSl Choose r = 2Vb. Then E^,,, C Cr/2 = {x G M"^ : Lqx G 
[—1,1]'^}. Choosing e = 1/16 in Lemma [3l3] we get Rs,w,2r \detQ\~^^'^wr'^~'^ for 
smoothing regions since the boundary of Ea^b does not intersect the 3£-boundary of Cr- 
Furthermore, in Lemma [3.31 note that with these choices voliJ(r) = volC,. fl -Ea,fe) 
|det Ql"^^^?"'^, see |BG99) . Moreover, by the choice of e and r all lattice points in Ea^t 
will receive the weight 1. Accordingly we set the terms estimating the intersection with 
the 3£-boundary of Cr to zero, i.e. drop the terms {b — a)e in (I3.19p . (I4.37p . and the 
summands e in (I7.30p and (I7.3ip . Note that apart from Lemma 13.31 the property that 
Q is indefinite has not been used in all the subsequent arguments(!). Thus (I7.30p leads 
to the following bound using < w < 1 

\vo\z Hr - vol Hr\ (7.39) 
«, /-2(|det Ql'^/^w + (^log(^i;-i)7[T_,T+],^(r) + cqTI)) 

+ |detg|-^/V^/2 logr. 
Thus, choosing w < 1 such that |det = q^/"^ CqCqT'l we get with 

T+ = BQTl'hiT.), Bq = |detg|-(i/2-^g-3/2 ^j^^^^ j^^rp_^ (^log(r_g-V2)y/2j^ 
and 

PQ(r)'=^'inf|log(rrM7[T_,T+],/5(r) + CQT! : T_ G KM]}, (7.40) 
|volzi/. - voli/,| <d r^"VQW + |detQ|-^/V^/2iQg^_ ^^Al) 
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Note that as in the indefinite case hmr_>.oo p(^) = if Q is irrationaL This proves 
Corollary O 

Proof of Corollary 12.71 Using Corollary 15.111 we may estimate pQ f,_a{r) and 
in (17:381) . By (JMHD and 1^, 7[T_,T+],/3(r) < \detQ\^'/^r-'' max (T:^^^^\T:^y , where 

/i =^ 1/2 — /3, =^ 2(1 — K,)fi, T4. = h(T^)Tl'', the evaluation of pQ^b~a{f) in (I7.38P leads 
to the minimization of ^ 

s — )■ |logs|'^^CQ_(f,_a).r"'^max js"-'^"'', s"'^''|log sp'^j + cg (fe — a)*s'^j for 1 > s > + 

r"^/*", where CQ,(b-a)* is a polynomial in |log(6 — a)*| and ^ = /ic?, (see Theorem 12. ip . For 
sufficiently small k > (depending on d), s~'^~^ dominates s~'^''|log sp'^. Minimizing the 
resulting function of s, we obtain for r sufficiently large PQ^b-aif^) *^d,Q (log r)^'^r~'^i ((6— 
a)*)^^''^ where z/i = i^/((l + k)h + ^) and z/2 = 1/((1 + k)p + ^). Thus (H^^ implies 

A. «Q,d,K,A r^^n(& - a)*)""' + r^'^'^ir, b-a), (7.42) 
which proves Corollary 12.71 when rewriting Ui = 2(1 — K,)/{d + 1 + k) and 1^2 = l/{d + 

1 + 

Proof of Corollary 11.51 It suffices to prove that vo\^d{Cr H Ea^b) > for any 
a,b E [— Cor^, Cor^]. and Q,k,a,q'"~''" < b — a with a sufficiently large constant Cd^K,A,Q- 
Assuming that b — a> and r is sufficiently large, ( 13. Sp shows that vol(Cr.n£'a,b) 
|det Ql^^^^ (& — a)r^^'^ > 2 by (13. 8p . By Corollarv 12. 7^ denoting the implied constant 
in (I2.14P by a^^u^i^ Q, say, we have to show that for large r ad^f^^A,Q{i^~'^^{{b — a)*)~'^^ + 
r~''/^^(r, 6 — a)) < 1/2. For b — a< r/2 we obtain ad,K,A,Qr~'^^'^^{r,b — a) < 1/4. Hence 
we should choose b — a large enough, such that ad,D,K,Q^~'^^{{b — a)*)^^'^ < 1/4 holds. 
This holds (and is compatible with the asumption b — a > r^^ above), once we require 
that b-a> {ad,^^A,Qr~''^y^''' '>d,K,A,Q r-"^/"^. Thus the result of Corollary O follows 
with an exponent z/q = Vi/v2 = (1 ~ '^)/(l ~ (4 + S)/d). 

Proof of Theorem [HI For > 5 and go > 1 and /3 = 2/d + 6/d, <^ = d{l/2-f3) = 
d/2 — 2 — 5 for an arbitrary small 6 > and e = Eq < 1/9, such that a{d)eo = 1/16 

we shall choose the other parameters r = Rq, T = Tq, = Tq^, and the interval 

w 

[a,b] = [—1,1] and w = Wq such that a{d)— = 1/16 (subject to restrictions). Then 
we split the error terms of Theorem 12.11 see (17.3ip . as follows 

I volz H{r) 
' vol H{r) 

Jl = EqCqT^_, J2 =^^qCq exp{-c(TQWo)^/^}), J3 = EqRq'^^'^^^, 

J4 Eq^^t^_^Tc,U, EQ''^a{d)i\oge-,y\detQ\'l'(\detQ\-P'\). 

In the following c{d) denotes a generic constant depending on d only which may change 
from one occurrence to the next. Choose 

r = Rq ^=^'c(rf)|detQ|i/2gV(i/2-/3)(iog^)(d-i)/2_ ^743) 



1| < 1/16 + 1/16 + Jl + J2 + J3 + J4, say, where 
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Then J3 < 1/8, since Rq >d (|det Ql^/'^-^/^^)^/^'^-^). Furthermore, choosing T_ = 
Tq_ = c(d)|det Qj-i/'^g^^/^ we obtain Ji < 1/8 since {\det Q\^/^ CqCqY/' = \det Q\^/'^q^/' . 
Similarly choosing T = Tq = c{d)wQ^ log q we obtain J2 < 1/8, since \det Q\^^'^CqCq = 

With these choices we shall distinguish now the following 
Case 1. Assume that for the above choices, J4 < 1/8, that is 

aid)i\oge^y\detQ\'/'CQ^[T^_,T^]ARQ) < 1/8- (7.44) 

Then ([31]) implies Yo\zH{r) > |volif(r) >d i?Q^V|det Ql^/^ > 2 provided that 
Rq >d |detQ|i/(2'^-^) which holds for our choice of Rq. Hence there exist a nontrivial 
solution m G Z'^ of < 1 in the support of the smooth box which is contained 

1 /2 

in the set of x with ||Q_/ x||oo < Rq{1 + S^o)- Thus |det(5|, which proves 

Theorem 11.41 in this case. 

Case 2. Assume that for the choices above J4 > 1/8, that is 

/ N -(1/2-/3) 

llT^.,T^]ARQr' = inf , (RQ^M^t)) < 8a{d)iloge,y\detQ\'/'CQ. 

(7.45) 

Thus there exists a t = to G [^Q-j^q] such that the reciprocal a^-characteristic 
satisfies, see (12 .4^ and (12. Sp . 

R'^Q inf { vol(L,/L, n At,) : C R"", dim = d} < Dq, (7.46) 

where =^ (8a((i) (logeg "^)'^ |det QI^/^Cq)^/*^^/^^'^^ Here the infimum is taken over 
all linear subpaces of dimension d and At,j = Vg^to (Z'' x Z'') is the 2(i-dimensional 
lattice in M^'^ induced by the linear map 

VQ,Am,n) [RQiQl'^'m-toSQ'fn),RQ'Q'fn^, (7.47) 

such that Q = Q]^'^SQ]^'^; compare (15. 16^ . Let La denote the subspace in (17.46^ such 

that Rq vol{Ld/Ld fl At,) < Dq and let A =^ RQ{Ld H At,) denote a corresponding 
rescaled d- dimensional sublattice of L^. Then 

det A <^^<Dq. (7.48) 

Any element of the lattice A may be written as 

(A^i,Ar2) = (^Rl{Q+'^^m-toSQ'fn),Q]l\y {m,n) G (Z*^ x Z"^). (7.49) 

Define an endomorphism A on M'^ x by A{Ni, N2) = {0,Rq'^Ni + toSN2). Then 
we obtain for the standard Euclidean scalar product, say (■,■), on M*^ x R*^, writing 
N={N,,N2), 

Rq'{Nu N2) = {AN, N) - to {SN2, N2). (7.50) 
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Note that for (A^i,iV2) of d7:49|) . we have {S N2, N2) = Q[m] and A[N] = {AN,N) = 
{m, n). Furthermore, note that the Euchdean norm on x induces a norm on the 
space Ld by restriction and that Ld is isometric to (with the Euchdean norm) under 
an appropriately chosen isomorphism. 

Meyer (1884), |Mey84| , showed that there always exists for ci > 5 a solution Nq G 
A \ {0} of A[iVo] = 0, see Theorem 11.31 By the above mentioned isometry, the result 
of (Birch and Davenport (1958a)), |BD58b| . see Theorem 11.31 applies to the integer 

valued quadratic form A on the lattice A =^ Rq [Ld fl A^g) C Ld- Hence there exist a 
solution G A \ {0} of v4[A'o] = such that for an absolute constant Cd depending on 
the dimension d only 

\\N\\^<Cd{TTA^Y^'^'\et{kf. (7.51) 

In view of f l7.50p and f l7.5ip we obtain for this element = {Ni,N2) G A (of type 
([732])) by Cauchy-Schwartz and fl73T]) together with fTTig]) 

/ \{d-l)/2 

\toRlQ[n]\ < llA^ill ||A'2|| < ||A^f < Cdf TrAM det (A)^ 

< Cdl^TiA^y'^^'^^'D^Q < Cdd'-'ltof-'Dl, (7.52) 

since Tr A^ = tgTrS'^ = t^d. Thus \Q[m\ \ < 1, provided that 

\toRl\>Cdd''-'\to\''-'Dl. (7.53) 

Since |to| < Tq <^d ^ogq, this requires Rq > c{d) {log qY^"^^^ Dq, which holds by our 
choice (17^43]) of i?Q, since Dq = c{d) |det Q|i/2^^/(i/2-/3)_ Furthermore, by ([73H1), <^Ml, 
(17.5 ip and (I7.53P we conclude that 

Q4n] < \\N\\' «, |detQ|g2/(V2-/?)(logg)'^-i, (7.54) 

thus proving the bound (11.101) in Theorem 11.41 Although A^ 7^ 0, we still have to check 

1 /2 

that its component A^2 = Q+ n is nonzero. Assume that n = and hence m ^ 0. 
Then (TTig]) implies that A^2 = RgQ+'^m. Hence by (I73ip . i?^go||^f < \\Nf <d 
Dgilogq)'^^^ , which results in a contradiction for Rq = c{d) (log q)^^^^^^^ Dq. This 
conludes the proof of Theorem 11.41 
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